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PREFACE 
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manager,  for  his  guidance  and  encouragement  throughout  this  effort.  We  would  especially  like 
to  thank  the  HTI  Annual  Refi'esher  Training  Instructors  at  Kirtland  Air  Force  Base  and  the 
Special  Operations  Forces  (SOF)  participating  aircrews,  whose  cooperation  and  input  made  this 
research  possible. 
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ANALYSIS  OF  THE 

SPECIAL  OPERATIONS  FORCES  NETWORK  TRAINING 
FOR  JOINT  MISSION  OPERATIONS  SIMULATOR  TRAINING 


INTRODUCTION 


The  58*  Training  Support  Squadron  (TRSS)  at  Kirtland  AFB,  NM,  developed  a  high- 
fidelity  Combat  Mission  Training  (CMT)  capability  for  its  Annual  Refresher  Training  (ART) 
curriculum.  This  program  culminates  in  a  multiple-aircraft  training  operation  involving  five  on¬ 
site  networked  aircrew  training  devices:  the  MC-130P  Combat  Shadow  Weapons  Systems 
Trainer  (WST)  and  Satellite  Navigation  System  (SNS),  the  MH-53J  Pave  Low  WST,  the  TH- 
53A  Operational  Flight  Trainer  (OFT),  the  MH-60G  Pave  Hawk  WST,  and  the  HH-60G  OFT. 
These  devices  provide  high-fidelity  simulations  of  aircraft  and  environmental  simulations.  These 
simulations  include  the  Digital  Radar  Landmass  System  (DRLMS),  Inflated  Detection  Systems 
(IDS),  Night  Vision  Devices  (NVDs),  and  Integrated  Electronic  Combat  Simulation  System 
(lECSS);  and  fully  correlated  image  generator  (IG)  display  systems. 

This  networked  combination  of  realistic  training  devices,  coupled  with  high-fidelity 
geospecific  databases,  has  enabled  a  Special  Operations  Force  (SOF)  Network  (SOFNET) 
training  capability  that  combines  dissimilar  training  devices  in  real  time  on  a  common  Area  of 
Operation  (AO).  A  fiber-optic,  reflective,  memory-based  network  links  these  simulators.  This 
central  Intersimulator  Network  (ISN)  permits  real-time  interactivity  through  the  AO.  The  ISN 
treats  each  non-ownship  simulator  on  the  network  as  a  moving  model.  TTiis  feature  allows  the 
Training  Observation  Center  (TOC)  and  the  Audio  Visual  Recording  Studio  (AVRS)  to  be  linked 
to  the  ISN,  rather  than  to  each  simulator  individually,  which  provides  an  efficient  means  to  view 
all  the  simulators  at  once.  Importantly,  the  SOFNET/ISN  creates  a  true,  shared  mission  rehearsal 
(MR)  and  training  capability  since  multiple  aircraft  (crews)  can  plan,  prepare,  and  execute  a  joint 
mission. 

While  these  advancements  hold  great  potential  for  training  applications,  little  is  known 
about  how  training  has  been  affected  since  networked  simulation  methods  have  been  integrated 
into  the  curriculum.  This  report  summarizes  the  results  of  a  preliminary  investigative  project 
whose  purpose  was  to  document  multiple  crew  training  methods,  and  crew  reactions  to  SOFNET 
training. 

This  report  is  presented  in  sections.  In  the  first  section,  we  describe  how  the  TRSS’s  ART 
has  evolved  as  a  training  program.  Following  this,  we  provide  a  conceptual  model  that  serves  as 
Ae  basis  for  illustrating  the  SOFNET  environment  fi'om  three  perspective  levels:  Training 
Devices,  Scenario  Command  and  Control,  and  Mission  Elements.  The  third  section  describes  the 
methods  of  the  research,  including  the  research  participants,  data  collection  instruments,  data 
collection  procedures  and  techniques,  and  the  resultant  data  structure.  This  section  also  discusses 
both  the  empirical  data  and  descriptive  comment  data  collected  from  subjects  who  participated  in 
the  research.  Finally,  this  report  concludes  by  discussing  implications  for  administering  CMT 
within  Ae  TRSS,  and  the  need  for  conducting  further  applied  effectiveness  and  transfer  of 
training  research. 
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TRAINING  PROGRAM  EVOLUTION 


The  ART  conducted  by  the  TRSS  is  a  high-priority  training  requirement  for  SOF 
mission-qualified  aircrew  members.  The  appropriate  Air  Force  and  command  directives  specify 
the  content  of  this  training-the  training  matter  may  be  assumed  to  be  a  relative  constant  as 
aircraft  systems  and  procedures  do  not  change  regularly.  The  ART  curriculum  at  Kirtland, 
however,  has  undergone  major  shifts  with  regard  to  both  the  manner  and  matter  of  training  in 
recent  years. 

Refi-esher  training  consisted  generally  of  academic  classroom  sessions  covering  aircraft- 
specific  systems  and  emergency  procedures  reviews.  Following  each  half-day  classroom  session, 
crewinenibers  were  then  required  to  apply  these  lesson  topics,  in  a  partial-task  training  approach, 
in  their  aircraft-specific  simulator.  ITiis  modular  training  method  worked  well  for  many  years, 
and  those  AF  units  using  this  system  were,  for  the  most  part,  satisfied  with  the  training  provided. 
There  was,  however,  a  growing  consensus  in  the  relatively  small  SOF  community  that  the 
expense  of  bringing  crews  to  Kirtland  each  year  for  a  repeat  of  the  same  anticlimactic  curriculum 
was  becoming  prohibitive.  The  leadership  at  Kirtland  responded  by  incorporating  the  network 
simulation  capability  to  the  ART  curriculum. 

TTie  residt  has  been  a  very  noticeable  shift  in  training  philosophy  fi'om  aircraft  systems 
malfunction  training  for  individual  crewmembers  to  a  combat  mission  training  orientation  for 
full  mission  teams.  Systems  training  was  not  deleted  in  this  new  training  philosophy;  rather, 
systems  malfunctions  were  now  required  to  be  exercised  in  real-time  in  the  complex  combat 
mission  environment.  ART  crews  performed  their  corrective  actions  to  instructor-induced 
systems  malfunctions  and  emergency  procedures  while  other  combat  stressors  (e.g.,  threats)  also 
inflicted  a  toll  on  the  mission  team’s  actions. 

Coincident  with  the  shift  in  training  philosophy,  the  aircrew  training  devices  and  host 
computers  were  undergoing  significant  upgrades.  The  resultant  increases  in  simulation  fidelity 
have  afforded  new  and  unique  approaches  to  training  that  had  not  been  previously  possible. 
With  the  integration  of  electronic  warfare  systems,  countermeasures,  improved  visual  systems 
and  correlated  sensors,  crews  could  now  perform  real-world  joint  operations  missions  in  a 
simulated  environment.  The  combination  of  improved  simulation  technologies,  a  vision  for 
implementation  of  distributed  interactive  simulation  (DIS)  methods,  and  a  customer  thmst  for  a 
mission-specific  and  joint  operations  training  curriculum,  led  the  TRSS  to  implement  SOFNET 
training. 


RESEARCH  ENVIRONMENT 

This  evolution  of  networked  simulation  technologies  at  the  58  TRSS  is  providing  training 
environments  that  more  closely  re^mble  multiship  operations  that  graduates  will  likely 
encounter.  There  is  a  longstanding  belief  that  performance  of  combat  aviators  in  combat  environ¬ 
ments  can  be  enhanced  through  large  group  training.  Red  Flag  and  Joint  Readiness  and  Training 
(JRT)  exercises  are  two  examples  of  live  training  that  allow  crews  to  experience  flight  operations 
at  a  more  tactically  realistic  scale  than  is  possible  during  routine  squadron  training  flights. 

Unfortunately,  live  training  at  this  level  occurs  infi-equently  and  shrinking  military 
training  budgets  are  adding  pressure  to  .  reduce  the  fi-equency  of  live  exercises  even  more.  In 
response,  there  is  widespread  interest  throughout  the  Department  of  Defense  in  the  ability  of 
networked  simulation  to  increase  the  scope  and  realism  of  warfighter  training.  Technologies 
simlar  in  function  to  the  58*  Special  Operations  Wing  (SOW)  SOFNET  are  being  developed 
within  both  research  and  training  communities  to  provide  synthetic  environments  that  enable 
warriors  to  train  as  members  of  larger  tactical  teams. 
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In  addition  to  expected  cost  savings,  a  simulated  combat  environment  provides  special 
instructional  advantages  that  are  not  found  on  ranges  which  have  a  variety  of  training  constraints. 
For  example,  range  training  restricts  the  electronic  warfare  aspects  of  the  battle  due  to  security 
considerations,  while  simulator  training  allows  for  a  complete  range  of  electronic  warfare  tactics 
to  be  conducted. 

The  value  of  these  technologies  will  obviously  depend  upon  how  they  are  used.  The 
Warfighter  Training  Research  Division  of  the  Air  Force  Research  Laboratory  (AFRL/HEA) 
established  a  research  program  to  develop  guidelines  that  will  allow  instructors  and  trainees  to 
take  maximum  advantage  of  synthetic  multiship  environments  (Carroll  &  Andrews,  1996). 
Goals  of  this  research  include  identifying  skills  and  knowledge  that  should  be  trained  using 
multiship  simulation,  exploring  novel  training  interventions  made  possible  by  synthetic 
environments,  and  determining  how  such  training  should  be  evaluated. 

In  support  of  AFRL/HEA’s  “Training  the  Warfighter”  research  program,  we  documented 
lessons  learned  and  crew  reactions  to  the  integration  of  SOFNET  into  the  ART  syllabus  of 
inaction.  This  allowed  an  early  look  at  networked  simulation  in  the  context  of  an  Air  Force 
mission  training  school. 

In  this  initial  application.  Day  4  of  ART  was  dedicated  to  SOFNET  training.  A  mission 
tasldng  was  provided  to  the  crews  in  an  0800  briefing.  The  remainder  of  the  morning  was 
available  for  mission  planning.  The  mission  plan  was  briefed  mid-day  and  executed  in  the 
afternoon.  The  simulator  session  was  usually  completed  about  1700  at  which  time  a  crew  debrief 
and  an  instructor  “hot  wash”  occurred.  The  people  being  trained  were  mission-ready  MC-130P, 
MH-53J,  or  MH-60G  crews  from  operational  units  around  the  world  who  were  receiving  ART  at 
Kirtland  AFB.  As  a  residt,  crewmember  reactions  provide  feedback  from  front-line  warriors 
concerning  the  desirability  and  value  of  multiship  simulator  training  as  part  of  the  ART 
experience. 


SOFNET  TRAINING  ENVIRONMENT 

The  SOFNET  traimng  environment  may  be  envisioned,  for  the  organization  purposes  of 
this  report,  as  the  notional  intersection  of  three  modularized  components:  Training  Devices, 
Scenario  Command  &  Control,  and  Mission  Elements  (Figure  1). 

Training  Devices 

The  first  component  may  be  defined  for  our  purpose  as  the  composition  of  participant 
crews  who  are  represented  as  “players”  in  their  respective  networked  training  device(s).  This 
critical  component  may  be  comprised  of  any  combination  of  network  participants,  and  the 
training  scenario  and  environment  is  manipulated  based  upon  the  matrix  of  participants 
scheduled  for  the  training.  As  discussed  in  the  following  sections,  current  participant  capability 
may  include  any  combination  of  crews  in  the  follovwng  training  devices:  the  MC-130P  Combat 
Shadow  WST  and  SNS,  the  MH-53J  Pave  Low  WST,  the  TH-53A  OFT,  the  MH-60G  Pave 
Hawk  WST,  and  the  HH-60G  OFT.  We  anticipate  additional  participants  to  be  added  to  the 
network  with  the  Aerial  Gunner/Scanner  Simulator  (AGSS)  expected  in  1997  (Silverman 
Spiker,  &  Nullmeyer,  1996). 

To  further  illustrate,  one  training  scenario  may  have  MC-130P,  MH-60G,  and  MH-53J 
participant  crews  flying  the  MC-130P  WST/SNS,  the  MH-60G  WST,  and  the  MH-53J  WST 
respectively,  with  an  instructor  crew  tasked  to  fly  the  TH-53 A  OFT  in  an  aggressor  mode.  This 
combination  of  participant  crews  dictates  one  specific  direction  that  the  training  scenario  may 
take  and  a  particular  set  of  mission  variables  or  outcome  parameters  that  might  be  considered 
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Figure  1.  SOFNET  Environment 


ac^ptable  must  be  established  for  this  scenario.  It  is  reasonable  to  assume  that  the  potential  for 
different  mission  outcomes  in  the  SOFNET  training  session  is  a  direct  function  of  the  number 
and  composition  of  participant  crews,  as  described  below. 

MC-130P 

WTO'T  particip^t  crews  perform  their  simulated  mission  operations  in  the  MC-130P 

WST.  This  device  is  a  six-degree-of-freedom,  high-fidelity  weapons  systems  trainer  based  on 
the  crew  and  systems  configurations  of  the  MC-130P  Combat  Shadow  aircraft.  This  device  uses, 
among  others,  a  CompuScene  V  image  generator  system,  a  fully  correlated  IDS,  a  DRLMs’ 
Mvigation  systems,  ^d  out-the-window  (OTW)  displays.  Simulated  navigation  systems  include 
Doppler,  inertial  navigation  system  (INS),  conftol  display  umts,  and  a  central  computer  system 
that  integrates  various  flight  systems. 
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The  MC-130P  WST  is  cxirrently  configured  to  match  the  Special  Operations  Forces 
Improvements  (SOFI)  version  of  the  MC-130P  aircraft,  while  the  SNS  is  coirfigured  after  the 
HC-130P  cockpit  configuration,  both  currently  being  flown  by  Air  Force  Special  Operations 
Command  (AFSOC)  units.  When  manned  by  participant  crews  fi-om  these  units,  the  MC-130P 
aircrew  consists  of  an  Aircraft  Commander  (AC),  Copilot  (CP),  Left  and  Right  Navigators  (LN, 
RN),  Flight  Engineer  (FE),  and  Communications  Specialist  (CS).  Both  pilots  and  navigators, 
and  the  FE  normally  perform  their  mission  duties  in  the  WST,  while  CSs  perform  their  duties  in 
the  SNS.  These  participants  are  mission  qualified  and  trained  to  handle  special  mission  tasking 
that  may  incorporate  several  mission  events  such  as  NVD  low-level  operations,  aerial  refueling, 
airdrop,  and  iiAl/exfil  operations. 

Closely  linked  to  the  WST,  the  SNS  is  a  part-task  trainer  used  to  independently  train  HC- 
130P  navigators  (NAVs)  and  CS  crewmembers.  This  device  may  operate  in  an  independent 
mode  or  in  an  integrated  mode.  When  in  independent  mode,  the  device  operates  independent  of 
any  other  device  and  is  used  to  tram  only  the  Nav  and/or  the  CS  in  crew-position  specific  tasks. 
This  device  might  be  used,  for  example,  for  the  NAV’s  procedures-oriented,  overwater,  celestial 
navigation  practice,  or  for  the  CS’s  secure  communications  practice.  When  in  this  mode,  the 
SNS  instructor  must  assign  the  DRLMS  radar  system  display  to  either  the  WST  or  the  SNS. 
Once  assigned,  the  alternative  device  will  not  have  a  radar  display  for  training 

When  in  integrated  mode,  however,  the  SNS  operates  in  conjxmction  with  the  WST.  The 
Nav  may  be  trained  fi-om  either  the  WST  or  SNS  location  in  this  configuration,  while  the  CS 
remains  located  in  the  SNS  for  orchestrated  training  with  the  crew  in  Sie  WST.  This  is  the 
configuration  that  is  typically  used  when,  for  example,  a  full  MC-130P  crew  is  tasked  to  conduct 
mission  operations  trai^g.  The  pilots,  navigators,  and  flight  engineer  are  located  in  the  WST, 
and  the  CS  is  located  in  die  SNS.  This  is  just  like  the  SOFI  aircraft  where  the  CS  station  is 
geographically  separated — ^i.e.,  located  in  the  cabin  compartment  to  the  rear  of  the  flight  deck. 

Other  participant  crews  who  fly  only  the  HC-130P  may  also  attend  ART,  but  they  are 
required  to  fly  the  MC-130P  WST.  ’^^en  this  is  the  case,  the  crew  composition  is  the  same  as 
list€^  above  with  the  sole  exception  that  there  is  only  one  navigator  present.  This  Nav  does  not 
fly  in  the  WST  as  the  navigator  station  does  not  represent  the  same  coiifiguration  as  the  HC- 
130P.  Instead,  this  navigator  performs  duties  in  the  remote  SNS,  which  is  configured  to  match 
the  HC-130P  aircraft,  and  is  operated  in  the  integrated  mode  with  the  WST. 

MH-53J 

MH-53J  pilote  and  flight  engineers  perform  their  simulated  mission  script  in  the  MH-53J 
WST.  This  device  is  a  six-degree-of-fi^dom,  high-fidelity  weapons  systems  trainer  based  on 
the  crew  and  systems  configuration  of  the  MH-53J  Pave  Low  helicopter.  This  device  uses  a 
CompuScene  V  image  generator  system;  fully  correlated.  Forward  Looking  Infirared  Radar 
(FLIR),  radar,  navigation  systems,  and  out-the-window  displays.  Navigation  systems  include  a 
Global  Positioning  System  (GPS),  Doppler,  INS,  control  display  units,  and  a  central  avionics 
computer  system  that  integrates  the  various  flight  systems. 

The  MH-53J  WST  is  currently  configured  to  match  the  same  aircraft  and  to  support  AC, 
CP,  and  FE  participants  fi-om  several  AFSOC  squadrons.  These  participant  crews  are  mission 
qualified  and  trained  to  conduct,  for  example,  insertion  and  extraction  operations,  combat  search 
and  rescue  operations,  gunship  escort,  and  shipboard  operations.  Air  Combat  Command  (ACC) 
units  who  fly  the  HH-53B/C/H  helicopter  may  also  attend  ART.  Although  the  WST  is  not  an 
exact  replication  of  their  aircraft,  these  participants  are  required  to  perform  their  duties  in  the 
MH-53J  WST  and  are  asked  to  simply  understand  and  work  around  &ose  differences  between 
the  WST  and  their  own  aircraft  configurations. 
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MH-60G 


MH-60G  ACs,  CPs,  and  FEs  perform  their  simulated  mission  script  in  the  MH-60G 
WST.  This  device  is  also  a  six-de^ee-of-freedom,  high-fidelity  weapons  systems  trainer  based 
on  the  crew  and  systems  configuration  of  the  MH-60G  Pave  Hawk  helicopter.  Like  the  MH-53  J, 
the  MH-60G  WST  uses  an  8-channel,  fully  correlated,  CompuScene  V  image  generator  for  both 
OTW  and  FLIR.  Additionally,  this  device  uses  DRLMS  for  multimode  radar,  and  contains  a 
fully  replicated  cockpit  with  all  tactical  and  conventional  avionics  systems  either  simulated  or 
stimulated. 

The  MH-60G  WST  is  also  configured  to  match  the  same  aircraft  and  designed  to  support 
mission  training  of  participant  crews  from  AFSOC.  ACC  and  Air  Force  Reserve  (AFRES)  crews 
also  fly  the  HH-60  helicopter  and  may  also  attend  ART.  Although  the  WST  is  not  an  exact 
replication  of  their  aircraft,  these  participant  crews  may  still  perform  their  duties  in  the  MH-60G 
WST,  or  the  HH-60G  OFT  (described  below).  Again,  like  the  MH-53J,  participant  crews  are 
asked  to  understand  and  work  around  those  differences  between  the  WST  and  their  own  aircraft 
configurations. 

TH-53A  OFT 

Participant  crews  may  also  perform  their  simulated  mission  script  in  the  TH-53A  OFT. 
This  device  is  a  six-degree-of-fireedom,  high-fidelity  simulator  based  on  the  crew  and  systems 
configuration  of  the  TH-53A  helicopter  and  designed  to  support  mission  training  of  AC,  CP,  and 
FE  participant  crews.  It  is  a  modification  of  an  H-53  simulator  and  uses  a  CompuScene  V  visual 
system  to  provide  a  photo-specific  training  environment.  The  TH-53A  OFT  is  typically  used  as 
a  part-task  trainer  ^TT)  to  tredn  participant  crews  in  basic  contact,  emergency  procedure, 
instrument,  and  initial  day  and  night  tactical  (including  NVD)  operations.  All  cockpit  switches 
and  instruments  in  this  device  are  functional,  where  required,  to  support  these  training  tasks. 
When  in  the  network  mode,  however,  the  TH-53A  OFT  fimctions  as  an  aggressor  attack 
helicopter  allowing  advanced  air  combat  training  to  be  conducted. 

HH-60G 

Participant  crews  may  also  be  required  to  perform  their  simiilated  mission  script  in  the 
HH-60G  OFT.  This  device  is  a  non-motion  device  used  to  augment  the  mission  training 
capabilities  of  the  MH-60G  WST  and  designed  to  support  mission  training  of  AC,  CP,  and  FE 
participant  crews.  This  device  features  a  “cross-view”  wide  display  system  and  a  six-channel, 
PT-200  image  generator,  allowing  day,  dusk,  night,  and  NVD  flight  operations  in  highly  realistic 
database  AOs.  A  replicated  crew  and  systems  cockpit  includes  operational  radar,  FLIR,  and 
navigation  systems.  Seat  shakers  and  a  digital  audio  system  help  to  prevent  simulator-induced 
motion  sickness,  and  provides  realism  for  basic  and  combat  training  tasks  including  low-level 
flight  and  shipboard  operations. 

AGSS 


Finally,  gimners  and  scanners  will  perform  their  mission  operations  in  the  Aerial 
Gunner/Scanner  Simulator,  once  it  becomes  networked  (currently  scheduled  for  late  1997).  This 
device  is  a  three-de^ee-of-freedom  (pitch,  roll,  and  heave),  ground-based  trainer  that  is  designed 
to  provide  both  basic  skills  and  mission  rehearsal  weapons  training  for  aerial  gunner  (AG),  FE, 
and/or  pararescue  personnel.  The  AGSS  is  a  reconfigurable  (Nffl-53J  and  MH-60G)  device, 
capable  of  simultaneously  training  as  many  as  three  guimers/scanners  using  virtual  reality  visual 
system  display  technology,  and  computer-scoring  of  air-to-air  or  air-to-ground  gunnery 
performance  against  fixed  or  moving  targets.  The  main  components  of  the  visual  system  are 
three  helmet-mounted  displays,  three  head-tracker  systems  (which  generate  information  based  on 
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head  position  and  attitude  for  the  image  generation  system  on  each  gunner),  and  an  image 
generator.  The  AGSS  is  designed  to  operate  as  a  standalone  trainer  (AGSS  only),  an  integrated 
crew  trainer  (AGSS  with  a  host  cockpit—either  the  MH-53J  WST  or  the  MH-60G  WST),  or 
networked  (AGSS  with  a  host  and  multiple  training  devices). 

Scenario  Command  and  Control 

Scenario  Command  and  Control  is  represented  by  players  who  are  scripted  into  the 
particular  combat  mission  training  scenario.  Role  players  represent,  for  example,  the  Airborne 
Command  and  Control  Center  (ABCCC),  the  Airborne  Warning  and  Control  Center  (AWACS), 
a  ground  assault  team  commander,  a  simulated  transload  aircraft  at  a  forward  Landing  Zone 
(LZ),  intelligence  (INTEL),  etc.  The  Training  Director  (TD)  or  Mission  Director  (MD)  weave 
Aese  simulated  operations  elements  into  a  cohesive  execution  of  the  mission  elements. 

These  individual  entities,  when  represented  by  live  role  players,  are  physically  located  in 
the  Training  Observation  Center  (TOC),  and  fall  under  the  control  and  discretion  of  the  TD  or 
MD.  They  are  tasked  to  follow  the  fluid  mission  script,  when  able,  as  the  training  scenario 
develops,  and  intervene  as  necessary  to  steer  the  mission  to  its  intended  training  conclusion. 
These  live  players  must  understand  and  control  the  limitations  and/or  capabilities  of 
SOFNET/INS  and  each  of  its  associated  training  devices.  They  work  to  integrate  all  SOFNET 
components  and  provide  the  necessary  command  and  control  (C2)  necessary  to  support  the 
training  objectives. 

For  example,  mission  participants  may  be  reacting  to  dynamic  training  conditions  in  a 
maoner  that  was  not  originally  intended.  In  order  to  get  tiiese  participants  on  the  correct  track, 
they  might  be  “  steered”  to  a  successful  outcome.  To  illustrate,  a  helicopter  crew  might  have 
failed  to  push  a  fi-equency  change  after  inserting  a  ground  assault  team  into  an  unsecured  drop 
zone  (DZ).  Consequently,  the  ground  team  commander  would  be  unable  to  call  for  fire  support, 
and  the  mission  objective  would  be  in  dire  jeopardy.  The  MD,  recognizing  a  need  to  intervene 
before  the  mission  comes  to  an  abrupt  and  unsuccessful  conclusion,  could  task  the  ABCCC  role 
player  to  inform  the  helicopter  crew  of  the  ground  team’s  attempts  to  make  contact  in  accordance 
wiA  the  Communications  Execution  Operating  Instructions  (CEOI).  In  this  maimer,  the  scripted 
mission  would  remain  fluid  without  direct  instructor  intervention  to  correct  a  faulty  course  of 
action,  and  the  crew  can  be  steered  to  a  successful  mission  outcome. 

Training  Observation  Center 

The  TOC  is  the  an  multimedia  auditorium  and  electronic  classroom  where  the  MD/TD 
and  role  players  are  centrally  located  to  guide  and/or  manage  the  simulation.  This  facility  is 
specifically  used  as  a  secure  simulator  scenario  and  network  control  center.  As  the  locus  for  the 
SOFNET  intersimulator  network,  up  to  six  role-player  stations  with  communications  capability 
to  each  of  the  simulators  is  used,  and  either  a  Training  Director  or  a  Mission  Director  position  is 
used  to  control  all  activities  in  the  TOC.  The  TOC  contains  a  simulator  display  system  with 
eight  35”  monitor  displays  and  two  60”  displays.  Each  of  the  35”  monitors  may  be  linked  to 
any  simulator  on  the  net,  and  the  TD/MD  selects  any  combination  of  screens  for  display  of  out- 
the-window  visuals  that  are  currently  being  viewed  in  a  particular  simulator.  Additionally,  a  60” 
monitor  is  used  to  display  the  projected  scenario  map  (i.e.,  the  “Fulcrum,”  as  described  below), 
which  can  be  stepped  through  various  scale  sizes.  This  feature  permits  the  TD/MD  and  role- 
players  to  monitor  the  development  of  a  particular  scripted  mission  scenario  or  exercise. 

The  Fulcrum  is  a  map-based,  mission-tracking  capability  that  allows  the  use  of 
VideoDisk-  or  CD-ROM-based  mission  maps.  The  Fulcrum  situational  display  is  automatically 
fed  certain  mission-relevant  overlay  data  extracted  from  the  SOFNET  control  computers.  This 
extracted  data  consists  of  pertinent  model,  position,  and  support  information  from  each  player  on 
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map  resolution  pd  geographic  region  of  interest.  The  Fulcrum  filters  the  overlay  data  based  on 
the  user  s  selections,  and  displays  icons  in  the  area  being  viewed  (representing  ownships,  moving 
models,  and  threats).  Each  TOC  operator  may  then  view  the  Fulcrum  at  their  own  control  station 
m  the  networked  mode,  which  allows  the  use  of  a  single  VideoDisk  or  CD-ROM  drive  to  provide 
map  sources,  while  at  the  same  time  allowing  each  user  to  view  the  overall  mission  tailored  to 
their  specific  interests. 


The  TOC  has  several  user-interface  stations  that  are  used  to  provide  a  role-playing 
capability  for  interactive  communications  during  the  multiship  SOFNET  mission  training 
sessions.  Each  user/role  player  station  is  comprised  of  a  PC-platform,  Microsoft  Windows- 
based  interface  for  configuring  the  user’s  communications  selections  and  accessing  the  Fulcrum 
situation  display  system.  The  user’s  intercom  allows  selection  of  any  UHF,  HF,  or  FM  radio  and 
frequency  combination.  The  actual  radio  communications  operate  in  much  the  same  manner  as 
in  the  real  world,  in  that  the  user  may  be  connected  to  any  other  TOC  user  and/or  simulator  crew 
position  on  the  SOFNET,  based  on  radio/frequency  matching.  In  addition  to  these  three  radio 
channels,  each  TOC  user  has  a  configurable  instructor  channel  that  allows  private 
commumcations  with  a  single  simulator  instructor  or  a  common  connection  to  all  instructors. 

Audio-Visual  Recording  Studio 


"nie  Audio-Visual  Recording  Studio  (AVRS)  is  a  commercial-quality  television  recording 
studio  that  may  be  mterfaced  directly  with  the  simulators.  The  AVRS  can  record  the  OTW 
scene,  the  sensor  displays,  and  the  radar/missile  warning  displays.  Both  secure  and  non-secure 
(open)  commumcations  between  simulators  may  be  recorded,  at  the  MD/TD’s  discretion,  and 
cop^it  cameras  and  VCRs  record  all  crew  activities  and  intercom  audio.  Additionally 
the  AVRS  video  can  be  displayed  on  all  of  the  TOC’s  eight  monitors,  or  the  Fulcrum  system. 

Integrated  Electronic  Combat  Simulation  System 


The  lECSS  piwides  a  full  electronic  warfare  (EW)  simulation  capability  for  the  MH-53J 
Pave  Low,  Nffl-60G  Pave  Hawk,  and  MC-130P  Combat  Shadow  WSTs.  The  lECSS  is  used  to 
realistically  simulate  (a)  the  electromagnetic  and  infrared  EW  environment;  (b)  threat  weapons 
d^aimcs  and  engagement  including  command,  control,  and  communications  (C3) 
charactenstics;  (c)  EW  defensive  systems  processing  and  environment  interactions;  (d) 
counterme^ures  effectiveness  calculations;  and  (e)  EW  systems  audio  and  video  interface  to  file 
aircrew.  The  fidelity  level  of  the  lECSS  simulation  is  sufficient  to  support  MR  for  qualified 
mSSs“^  to  programmed,  repeatable  training  to  qualify  or  upgrade  new  aircrew 


Mission  Elements 

Findly  the  Mission  Elements  component  may  be  envisioned  as  the  particular  mission 
ob^ctives  that  may  be  accomplished  depeni^g  upon  the  skill  and/or  capabUity  of  the 
participants,  or  the  C2  mission  assignments  in  accordance  with  the  frag’s  taslring  or  the 
development  of  the  nussion  scenario  as  the  script  plays  out  in  real-time  execution.  The  C2 
eluent  may  Anew  this  component  as  iJie  “toolbox”  of  events  that  may  be  performed  by  a 
partcular  combination  of  participants  in  the  network  training.  Specifically  the  SOFNET 
trainmg  session  may  be  comprised  of  any  combination  of  aircrew  participants’  with  differing 
mission  requirements  and  capabilities.  The  “toolbox”  of  mission  elements  that  would  emerge  ai 
^ssible  jomt  frammg  objectives  rnight  include,  for  example,  aerial  refueling,  formation  flight 
threate  and  toctics,  etc.  Upon  consideration  of  the  matrix  of  available  participants,  the  MD  mmht 
consider  tasking  a  different  set  of  mission  objectives  for  a  particular  training  session. 
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To  illustrate,  the  SOFNET  training  actually  begins  the  day  prior  to  mission  execution. 
Crewmembers  are  provided  with  weapons  system-specific  mission  packets  that  outline  the 
mission  tasking  details  in  a  form  that  resembles  a  typical  mission  “frag”  (that  has  been  extracted 
from  a  contingency  operation’s  Air  Tasking  Order).  The  packets  are  provided  in  advance  so  that 
crewmembers  may  familiarize  themselves  with  the  mission’s  details  and  specific  mission 
element  tasking  at  their  own  convenience.  Information  is  provided  that  allows  the  crews  to  relate 
to  the  general  scenario,  the  specific  mission  objectives  and  order  of  mission  elements, 
operational  weather  conditions  and  forecasts,  etc.  Additionally,  information  is  provided  that 
details  preplanned  Selected  Areas  For  Evasion  (SAFE),  air  and  groimd  order  of  battle,  and  both 
communications  and  mission  execution  checklists.  This  information  is  designed  to  provide  the 
participants  with  a  macro-level  familiarization  of  the  mission  objectives  prior  to  the  actual 
mission  brief  Finally,  participants  are  provided  with  a  comprehensive  package  of  specific 
planning  details  regarding  each  of  the  mission  elements  (for  example,  the  air  refueling  operation, 
and/or  threat  locations,  etc.). 

Mission  Tasking 

The  scripted  training  mission  is  conducted  in  the  Southwest  USA  (“  SWUSA”)  database, 
and  entails  a  hi^-level  mission  authorization  and  Warning  Order  to  conduct  POW  rescue 
operations  in  hostile  territory.  The  mission  scenario  includes  forced  entry  into  a  POW  compound 
to  return  coalition  force  detainees  to  fiiendly  control.  After  recovery  has  been  completed,  the 
assault  force  will  transport  recoverees  and  a  medical  team  to  an  abandoned  airfield  for  transload 
and  evacuation.  All  participant  forces  are  also  tasked  to  be  prepared  to  pickup  downed 
crewmembers,  as  required. 

This  mission  tasking  entails  a  complex  set  of  mission  elements  that  may  be  performed  by 
participant  crews.  Specifically,  the  MC-130P  WST/SNS  will  conduct  NVG  low-level  operations 
to  a  precoordinated  Air  Refueling  Control  Point  (ARCP),  and  provide  refueling  support  for  a 
helicopter  formation  (MH-53J  and  MH-60G)  prior  to  their  crossing  into  hostile  enemy  territory. 
After  the  refueling  operation  is  complete,  the  MC-130P  will  continue  its  NVD,  low-level 
operations  to  perform  an  airdrop  of  a  reconnaissance-reception  team  at  a  transload  airfield.  This 
site  is  to  be  used  by  the  helicopter  formation,  and  others,  to  conduct  blacked-out  Infil  landing 
operations,  and  transfer  of  personnel  to  a  waiting  (simulated  visual  model)  MC-130H  Talon 
aircraft. 

Next,  the  MH-53J  WST  will  fly  an  NVD,  low-level  route  as  formation  lead  with  the  MH- 
60G.  They  will  fly  to  the  prepl^ed  air  refueling  point,  conduct  refueling  operations  with  the 
MC-130P,  and  cross  the  fence  into  deep  hostile  territory.  This  territory  has  a  medium-level 
threat  saturation,  and  formation  tactics  and  altitudes  will  be  flown  appropriate  to  the 
enviroimient.  After  the  refueling,  the  objective  is  to  fly  to  the  hostile  POW  compound  and  insert 
a  special  forces  team  via  fastrope  procedures.  This  team  will  secure  Ae  compound,  with 
helicopter  air  cover  and  fire  support,  and  extract  the  fnendlies  back  onto  the  helicopters. 
Following  this,  the  helicopters  will  fly  to  the  transload  site  for  transfer  and  evacuation  of  the 
expatriated  POWs. 

The  MH-60G  WST  will  also  fly  low-level,  as  formation  wingman  to  the  MH-53J.  They 
will  also  fly  to  the  preplanned  air  refueling  point,  conduct  refueling  operations  with  the  MC- 
130P,  and  cross  the  fence  into  hostile  territory.  The  objective  will  be  to  assist  the  MH-53J  with 
the  insertion  of  a  special  forces  team  via  fastrope  procedures  into  a  POW  compound.  This  team 
will  secure  Ae  compound,  with  helicopter  cover  and  fire  support,  and  extract  Mendly  forces  back 
onto  the  helicopters.  Following  this,  both  helicopters  will  fly  to  the  transload  site  for  transfer  and 
evacuation  of  &e  expatriated  POWs. 
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Finally,  either  the  TH-53A  or  the  HH-60G  OFT  will  be  represented  in  the  visual  model 
set  as  a  threat  helicopter  (Hind)  who  has  located  a  precoordinated  attack  point.  For  this 
mission’s  purpose,  one  of  these  devices  will  be  used  to  conduct  live  aggressor  tactics  and  is 
manned  by  two  instructor  pilots  and  one  instructor  flight  engineer/simulator  operator.  Their 
objective  is  to  perform  multiple  attack  runs  on  the  helicopter  formation  and  attempt  to  divert 
them  from  their  primary  mission  tasking. 

METHOD 

This  section  describes  methods  and  procedures  we  used  to  conduct  the  research.  The  first 
subsection  describes  sessions  observed  and  participant  crews  from  whom  data  were  collected. 
The  second  subsection  covers  design  of  the  present  effort  where  we  discuss  the  logistic  features 
considered  essential  to  apply  a  naturalistic,  observational  approach.  Next,  we  discuss  the  survey 
instnmient  used  to  collect  empirical  data  from  participant  crewmembers.  In  the  final  subsection, 
we  discuss  the  procedural  steps  that  we  followed  in  collecting  the  observation  and  survey  data. 

Participants 

Data  were  collected  from  1 1  SOFNET  training  sessions,  encompassing  99  AFSOC  and 
ACC  crewmember  participants  (enlisted  and  officer),  conducted  between  13  Jun  96  and  24  Oct 
96  (see  Table  1).  These  volunteer  subjects  represented  a  mix  of  AC,  NAV,  FE,  and  CS  crew 
positions  for  the  MC-130P,  MH-53J,  HH-53,  MH-60G,  and  HH-60  aircraft  (see  Table  2). 
ObservaUon  and  comment  data  were  collected  primarily  from  a  position  located  in  the  TOC, 
where  direct  crewmember  performance  and  mission  development  feedback  could  be  received 
from  the  monitor  displays,  or  from  MD  and/or  role  player  personnel  remarks.  Additionally, 
portions  of  each  participant  crew’s  mission  preparation  and  mission  briefing  periods  were 
observed.  These  observations  were  performed  in  the  respective  participant  crew’s  mission 
planning  rooms,  which  presented  opportunities  to  openly  discuss  with  each  crewmember  and 
instructors  alike,  those  concerns  associated  with  networked  mission  training  for  operational 
requirements. 


Table  1 .  SOFNET  Sessions  -  Participant  Data 
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Table  2.  Subjects  by  Crew  Position  and  Weapons  System 
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Procedures 


Observations 

The  researcher’s  primary  responsibility  in  this  project  was  to  identify,  from  instructors, 
role  players,  crewmembers,  and  training  support  personnel,  those  key  issues,  achievements,  or 
performances  that  are  distinctive  of  the  SOFNET  training  method.  A  naturalistic  observation 
technique  was  chosen  as  the  first  approach  to  collect  data  related  to  the  conduct  and  quality  of  the 
SOFNET  training  sessions,  and  the  manner,  matter,  and  perceived  outcomes  of  the  training.  This 
approach  was  determined  to  be  acceptable  for  this  project’s  investigative  purpose  as  the  primary 
researcher  possesses  extensive  subject-matter  expertise;  an  intimate  understanding  of  current 
TRSS  training  doctiine;  and  extensive  flight,  training,  and  simulation  experience  in  joint  mission 
operations.  Additionally,  this  approach  allowed  us  to  capitalize  on  the  on-going  ART,  and 
provided  us  witihi  access  to  a  highly  experienced,  volunteer  subject  pool 

Survey 


A  second  approach  to  data  collection  was  to  capture  participant  crewmember  critiques 
regarding  the  relative  value  and  utility  of  SOFNET  training.  This  was  done  throu^  the  use  of  a 
questionnaire.  The  researcher’s  primary  role  for  this  purpose  was  administrative  in  nature, 
however,  many  participants  also  offered  commentary  statements  while  completing  their  surveys, 
as  a  result  of  insights,  and  recalled  from  the  survey  questions.  These  comments  or  issues  were 
discussed  with  other  participant  crewmembers  and  the  primary  researcher  in  an  open  forum 
manner,  and  were  recorded  along  with  the  observation  notes  for  later  analysis  and  presentation. 

The  SOFNET  Training  Survey  is  a  self-report  tool  that  is  divided  into  three  sections  (see 
Appendix  A).  The  first  section  captures  relevant  background  information  from  each 
crewmember  (e.g.,  crew  position,  flight  experience,  etc.),  such  that  a  descriptive  profile  of  each 
crewmember’s  basis  of  experience  may  be  established.  The  second  section  asks  respondents  to 
answer,  in  narrative  form,  questions  related  to  their  experience  with  the  network  mission. 
Following  this,  section  three  asked  for  (1:  Low  to  5:  High,  or  NA:  Not  Applicable)  ratings  and 
comments  on  &e  value  of  networked  simulation  relative  to  standalone  simulation,  across  each  of 
33  mission  elements.  Additionally,  a  last  item  asked  respondents  to  rate  the  “overall  value”  of 
networked  simulation.  The  purpose  of  section  three  was  to  establish,  from  those  participant- 
experts,  a  quantitative  scale  that  demonstrates  “where”  and  “how”  networked  simulation  has 
definite  advantage  over  standalone  simulation  training  methods. 

Design 


During  critical  phases  of  the  SOFNET  training  (i.e.,  mission  in-brief,  mission  execution, 
and  debrief,  observation  data  were  recorded  by  an  SME-researcher  from  an  intercom/control 
station  in  the  TOC,  located  immediately  adjacent  to  the  MD.  From  this  vantage  point,  our  SME- 
researcher  was  able  to  make  informed  observations  and  assessments  based  on  personal 
knowledge  and  expertise.  Additionally,  observations  of  interactions  between  the  MD,  role 
players,  and  support  personnel  (e.g.,  engineering,  etc.)  could  be  made,  as  well  as  providing 
opportunities  to  request  rationale  or  clarification  on  important  issues,  as  necessary. 

Following  mission  execution,  participant  crews  and  instructors  would  next  meet  in  the 
TOC  for  a  “mass  debrief.”  While  this  period  rarely  provided  any  consequentid  content 
regarding  academic  or  procedural  performance,  the  discussions  that  followed  were  fertile  ground 
for  the  primary  researcher  to  record  noteworthy  and  free-flowing  instructor  and  participant- 
crewmember  comments  related  to  joint  training  and  simulation  methods. 
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Following  the  mass  debrief,  instructors  released  participant  crews  to  report  to  the  SME- 
researcher  in  an  adjacent  room.  The  purpose  was  to  briefly  describe,  in  private  and  without 
instructors  present,  the  research  project  and  focus,  the  purpose  of  the  information  being  collected, 
and  the  researcher’s  role  in  collecting  information.  The  surveys  were  then  distributed,  and  the 
SME-researcher  remained  available  for  questions  or  explanation  until  all  SOFNET  Distributed 
Mission  Training  Surveys  were  completed.  This  period  generally  lasted  no  more  than  30 
minutes,  although  on  at  least  three  occasions,  several  crewmembers  remained  for  a  lengthy 
discussion  with  the  SME-researcher  on  the  concept  and  methods  of  networked  simulation. 

RESULTS 

Observations 

The  following  sections  present  a  summary  of  those  observations  made  during  the  conduct 
of  SOFNET  training.  Several  SOFNET  issues  are  discussed  with  respect  to  their  particular 
strengths,  weaknesses,  observations,  and/or  techniques.  First,  several  observations  regarding  the 
participants  are  described.  Then,  following  the  logic  of  the  SOFNET  environment  (Fig.  1), 
issues  are  outlined  into  three  sections:  Training  Devices,  Scenario  Command  and  Control,  and 
Mission  Elements. 

Participant  Crews 

Crews  are  scheduled  for  a  10+  hour  training  day.  The  SOFNET  training  day  begins  at  0730,  and 
barring  any  unforeseen  delays,  is  not  scheduled  to  end  until  1830.  While  the  length  of  the 
training  day  has  not  been  an  issue,  there  are  implications  that  should  be  addressed.  First, 
instructors  are  not  demonstrating  a  motivation  to  spend  this  much  time  and  effort  on  a  single 
training  mission.  They  feel  they  are  being  “over-tasked”  for  a  demonstration  purpose  only. 
And,  second,  participant-crewmembers  have  questioned  if  their  own  performance  can  be 
expected  to  improve  by  using  this  level  of  high-intensity  training  for  such  a  long  period  of  time. 

Crew’s  mission  tasking  requirements  present  differences  in  accordance  with  major  command 
(MMCOM)  procedures.  Currently,  the  SOFNET  training  scenario,  which  is  oriented  toward  a 
^ical  AFSOC  mission  tasking,  is  conducted  regardless  of  the  complement  of  participant  crews 
in  attendance  at  ART.  Very  often,  dissimilar  command  crews  are  represented  in  each  of  the 
helicopter  cockpits.  For  example,  the  MH-60G  WST  may  have  an  ACC  crew  qualified  in  the 
HH-60G  only,  and  unqualified  in  AFSOC  missions.  Crews  have  suggested  that  this  presents  a 
dilemma  to  foem  in  terms  of  how  to  perform  the  mission  tasking,  and  how  to  deal  with  differing 
aircraft  capabilities,  MAJCOM  procedures,  etc. 

Inadequate  or  iiicorrect  information  provided  for  mission  nlanninp.  Crewmembers  report  that 
foey  often  experience  information  deficiencies  in  mission  fi'ags  for  training,  or  the  information  is 
inadequate  for  certain  crewmembers  to  break  out  specific  details  necessary  to  perform  their 
individual  jobs.  Additionally,  some  mission  events  were  reported  as  being  somewhat  unrealistic. 
For  example,  crews  reported  foat  reasonable  tasking  for  MC-130P  tankers  is  not  likely  to  include 
extended  orbits  in  (any)  threat  environment  while  waiting  for  receiver  helicopters.  Thus,  there  is 
little  perceived  value  to  artificially  establishing  this  mission  requirement.  Tanker  crews  do, 
however,  regularly  practice  for  threat  environments,  and  they  plan  their  air  refueling  operations 
using  T  -else  low-level  timing  to  the  ARCP.  It  was  suggested  that  current  real-world.  Air 
Taskin,  Orders  (ATOs)  generally  provide  for  at  least  one  alternate  mission  tasking  in  the  event 
that  the  primary  mission  scrubs.  Finally,  some  crewmembers  remarked  that  their  specific  roles 
as  network  players  in  the  mission  script  was  not  as  clear  as  fiiey  would  have  preferred.  They  felt 
this  was  likely  due  to  the  limited  time  to  examine,  question,  and  prepare  individual  mission 
execution  plans. 


12 


Differences  in  crewmember  motivation  for  SOFNET  training.  Participant  crews  tended  to  be 
either  fully  opposed  to,  or  in  support  of,  the  current  network  training  meAodology.  The 
opposition  perspective,  adbeit  proposed  from  a  very  small  percentage  of  the  participants,  was  best 
represented  by  three  senior-ranking  MC-130P  crewmembers  who  hold  key  leadership  positions 
at  their  respective  group  level.  These  individuals  attended  the  ART,  and  indicated  resentment  in 
being  required  to  sacrifice  a  critical,  full  day  of  their  regular  classroom  and  simulator  emergency 
procedures  training  in  order  to  participate  in  the  network  simulation  mission.  In  the  absence  of 
comprehensive  training  objectives  that  explain  the  value  of  network  training,  these  crew¬ 
members’  perception  was  that  their  training  time  is  otherwise  being  drained  by  participating  in 
essentially  “ .  .  .the  [same]  mission  training  that  we  do  everyday!”  A  surprisingly  supportive 
perspective,  however,  was  reported  by  two  (ACC)  MH-60G  crews.  The  perspective  of  these 
crews  is  that  the  network  combat  mission  training  provides  an  unusual  opportunity  for  exposure 
to  the  SOF  mission.  These  crews  are  typically  tasked  to  fly  and  train  for  Combat  Search  and 
Rescue  (CSAR),  and  they  would  otherwise  not  be  exposed  to  the  dynamics  or  tasking  of  SOF 
missions.  At  least  one  MH-60G  crewmember  expressed  that  the  SOF  MH-60Gs  represent  only 
about  10%  of  the  fleet,  and  the  likelihood  of  exposure  to  these  missions  in  real  time  is  remote. 
Although  the  scenario  script  is  not  directly  applicable  to  (ACC)  MH-60G  training  requirements, 
these  crewmembers  reported  that  this  orientation  adds  incremental  value  to  using  a  networked 
training  methodology. 

Training  Devices 

Performing  mission  operations  in  a  fictitious  database  Area  of  Operation  (AOT  The  mission 
scenario  is  currently  scripted  in  an  unclassified  database  using  a  fictitious  country  setting  with 
made-up  names.  At  the  experienced  crewmember  and  ART  level,  there  appears  to  exist  little 
perceived  value  to  promoting  simiilated  mission  operations  in  such  an  artificial  manner. 
Participant  crewmembers  report  that  using  fictional  names  makes  the  scenario  more  difficult  to 
remember,  or  relate  to  any  personally  held  “mental  model”  of  the  world.  Conversely, 
participants  report  a  preference  for  conducting  complex  mission  operations  in  real-world  “hot¬ 
spot”  locations.  A  simulated  mission  scenario  requiring  such  manner  of  operations  would 
promote  an  enhanced  credibility  that  adds  to  the  fidelity  of  the  networked  training.  Additionally, 
such  a  strategy  could  encourage  crewmembers  to  accept  their  mission  tasking  with  appropriate 
seriousness  and  involved  thought.  It  had  been  suggested  that  modifying  the  scenario  in  this  way 
woxild  dramatically  increase  their  perceived  level  of  training  effectiveness. 

Aircraft  confimiration  and  performance  differences  with  training  device  fidelity.  The  MH-60G 
WST  and  HH-60G  OFT  have  two  different  engine  configurations  programmed  into  tiieir 
software.  Instructors  have  indicated  that  their  HH-60G  crewmembers  should  perform  the 
mission  operations  in  the  MH-60G  WST.  The  perspective  is  that  this  device’s  “higher”  fidelity 
with  regard  to  motion  and  visual  systems  and  aircraft  systems,  warrants  use  of  &s  device  in 
place  of  the  “lower”  fidelity  HH-60G  OFT.  However,  participant  crews  have  questioned  if  the 
differences  are  important  enough  to  warrant  less  than  optimum,  but  similar  to  the  aircraft, 
training  in  the  OFT. 

Manipulation  and  reprogramming  for  threat  encounters  is  a  difficult,  time-consuming  process. 
Instructors  were  observed  to  be  reluctant,  at  best,  to  perform  threat  manipulation  activities  (e.g., 
changing  locations,  status,  etc.)  in  the  dynamic  environment  represented  by  joint  operations.  In 
the  networked  mode,  a  high  level  of  coordination  among  instructors  in  each  device  must  occur  to 
place  and  activate  threats  without  adversely  affecting  each  other’s  training  progress.  The 
reported  fear  is  that  they  may  have  an  adverse  effect  on  the  other  WSTs  or  OFTs.  Regardless, 
the  procedures  and  effort  required  to  manipulate  a  threat  has  a  perceived  high  potential  to  disrupt 
the  network  mission,  and  most  instructors  appear  to  feel  that  it  is  acceptable  to  limit  training 
rather  than  change  threat  parameters.  (We’ve  seen  this  attitude  in  non-networked  operations 
also). 
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Extensive  mission  “setup”  procedures  required  to  operate  the  traininp  device.  When  instractors 
arrive  at  their  simulator,  they  are  required  to  set  (i.e.,  “progr^”)  a  number  of  simulator  initial 
conditions  for  their  particular  mission  involvement  at  their  instructor  operating  station  (lOS). 
These  conditions  are  device-dependent,  and  variables  must  be  specified  for  the  exact  coordinate 
position  and  orientation  of  the  aircraft,  weather  and  environmental  conditions  (e.g.,  illumination 
level,  wind  conditions,  altimeter  settings,  etc.),  route  of  flight,  etc.  Each  instructor’s  mission 
set-up  process  is  extremely  complex  and  time  consuming,  and  the  programming  process  often 
requires  in  excess  of  30  minutes  to  set  every  variable  and  fully  ready  the  device  for  its  intended 
mission  objectives.  Instructors  are  generally  unable  to  enter  the  simulator  early  to  preset  &eir 
mission’s  variables  in  advance  of  the  scheduled  mission  start  time,  as  the  simulators  are  typically 
being  used  for  other  training.  As  a  result,  the  actual  time  dedicated  to  training  is  reduced,  and 
crewmembers  often  find  themselves  waiting  for  the  instructor  to  program  the  simulator  to  be 
“  ready-for-training.” 

Visual  system  limitations  require  feat  aggressor  helicopter  perform  a  “bead-nn”  attark  The 
WST/OFT’s  visual  system  limitation  of  providing  only  forward  and  side-views  requires  the 
aggressor  helicopter  crew  to  perform  only  head-on  attacks.  This  requires  great  coordination 
effort  between  the  TOC  persoimel  and  the  aggressor  helicopter  crew  to  determine  the  location 
and  track  of  the  helicopter  formation,  to  position  (using  slew  function)  the  aggressor  in  jfront  of 
the  helicopter  formation  using  the  correct  reciprocal  track,  and  to  perform  the  actual  rendezvous. 
This  procedure  typically  took  several  unsuccessful  attempts  before  a  single  successful  attack 
operation  was  performed. 

Scenario  Command  and  Control 

MD  lacks  the  capability  to  gain  requned  information  on  training  conditions.  Presently,  there 
existe  no  capability  for  the  mission  director,  or  any  role  player,  to  select  a  specific  lOS  in  a 
particular  WST  or  OFT.  The  MD  reported  a  need  to  observe  ftie  specific  conditions  or  training 
forces  that  are  being  experienced  by  a  particular  crew,  to  help  identify  particular  system 
malfunctions  and/or  solutions.  Without  the  capability  to  select  and  observe  a  particular  lOS, 
systems  analysis  of  scenario  manipulation  must  be  done  only  after  extensive  coordination  (and 
distraction)  with  the  affected  instructor/operator. 

Limited  usefulness  of  TOC  monitors  to  view  mission  progress.  The  TOC  monitors  have  a 
limited  utility  to  the  MD  and/or  role  player  personnel  who  are  located  in  the  TOC.  The  monitors, 
when  used  to  view  the  out-the-window  view  of  the  respective  WST/OFT,  are  only  useful  to  TOC 
personnel  in  daytime  conditions  with  normal  lighting.  When  nighttime  conditions  are  used,  the 
NVG  presentation  is  extremely  poor,  and  very  little  imagery  is  discernible  to  the  TOC  personnel. 
Secondarily,  the  Fulcrum’s  map  display  does  not  employ  directionally  based  icons  or  track  lines. 
TOC  personnel  are  imable  to  flight  follow,  or  determine  if  the  crew  is  flying  the  planned  flight 
course.  ^  This  reduces  the  MD’s  effectiveness  by  increasing  the  workload  to  determine  the 
mission’s  progress.  Several  instructors  have  indicated  the  value  of  placing  a  dynamic 
Track/Heading/Groimdspeed  readout  next  to  each  icon. 

Dedicated  communications  line  needed  in  TOC.  There  were  many  occasions  when  the 
simulation,  or  a  particular  WST,  began  to  experience  problems.  The  MD  is  in  an  ideal  position 
to  oversee  or  coordinate  the  Technical  Support  Group’s  (TSG)  efforts  to  correct  the  problem. 
However,  in  the  current  configuration,  the  MD  must  physically  leave  the  TOC  and  locate  the 
TSG  personnel.  By  the  time  he  returns  to  the  TOC  with  these  individuals,  the  problem(s)  may 
have  manifested  themselves  in  different  ways.  It  was  suggested  on  several  occasions  that  a 
communications  link  (a  phone  line)  fi-om  the  TOC  to  the  TSG  would  allow  problems  to  be 
handled  interactively  and  in  an  efficient  manner. 
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Need  direct  communications  among  TOC  and  simulator  instructors.  Along  the  previous  lines, 
TOC  personnel  are  currently  unable  to  communicate  in  private  with  any  instructor  in  any  WST 
or  OFT,  and  conversely,  instructors  are  unable  to  independently  contact  any  other  WST/OFT 
instructors.  ITiere  were  many  occasions  when  an  instructor  in  one  device  needed  to  contact  or 
coordinate  with  an  instructor  in  another  device.  In  the  current  configuration,  an  instructor  who 
needs  to  contact  another  instructor  must  first  contact  the  TOC  personnel,  who  must  then  relay  the 
particular  message  to  the  desired  instructor/WST.  Additionally,  these  messages  must  be 
transmitted  over  one  of  the  aircraft/device’s  communications  radios  that  would  otherwise  be  used 
by  the  crewmembers. 

Unable  to  hear  individual  cockpit  intercom  without  AVRS  connections.  In  the  current 
configuration,  only  the  MH-53J  WST  or  TH-53A  OFT  can  be  “hot  wired”  so  that  a  crew’s 
intercom  may  be  monitored  by  TOC  personnel,  and  then  only  one  of  these  devices  may  be 
monitored  at  a  time.  To  do  so,  the  communications  channels  must  be  physically  set  up  by  trained 
AVRS  persoimel,  and  then  routed  into  the  TOC.  TOC  persoimel  are  unable  to  monitor  the  MC- 
130P  WST/SNS,  the  MH-60G  WST,  or  the  HH-60G  OFT,  as  the  AVRS  does  not  have  the 
capability  to  connect  with  these  devices.  The  TH-53A  was  typically  used  as  the  aggressor 
aircraft,  "with  instructor  crews,  thus  the  TOC  had  no  requirement  to  monitor  this  cockpit  crew. 
The  MC-130P  and  MH-60G,  however,  were  integral  components  of  the  mission,  and  the  MD 
indicated  a  reasonable  need  to  monitor  their  cockpit  communications  at  will.  Several  comments 
were  made  that  a  selectable  switch  to  permit  the  MD  or  instructor  role-players  to  monitor  any 
crew’s  interphone  communications  would  greatly  increase  the  effectiveness  of  their 
interventions. 

Instructors  need  current  Technical  Discrepancy  (TDI  and  Discrepancy  Report  (DR’t  listing  to 
know  what  is  written-up.  Instructors  indicated  they  are  traditionally  the  last  to  know  if  and/or 
when  a  TD  or  DR  write-up  has  been  cleared.  If  instructors  are  briefed  prior  to  the  day’s 
instructor  meeting  Avith  respect  to  which  simulator  systems  are  or  are  not  operational,  this  wovild 
significantly  help  the  instructor’s  efforts  to  formulate  an  effective  training  plan  for  their  crews. 

Debrief  lacks  purpose.  The  MD  states  in  the  mission  brief  that  the  purpose  of  this  mission  is  to 
“enhance  situational  awareness.”  There  was  no  observed  attempt,  however,  to  ensure  that  SA  is, 
in  fact,  enhanced.  The  debrief  makes  no  mention  of  the  SA  aspects  of  the  training,  there  are  no 
debrief  tools  used,  and  the  ensuing  debrief  discussion  always  turned  to  a  systems  and  procedures 
discussion  related  to  what  happened  (procedurally)  vs.  what  should  have  happened. 
Crewmembers  reported  that  the  current  mission  debrief  is  anticlimactic,  and  requires  a 
significant  infusion  of  content  to  connect  them  to  the  value  of  the  provided  training. 
Additionally,  they  reported  an  inability  to  discriminate  rationale  for  their  participation  in 
networked  simulation  training.  While  their  participation  in  the  demonstration  of  simulation 
technology  was  of  ^eat  in^iration,  the  perceived  value  in  outcome  terms  was,  for  the  most  part, 
an  unknown  quantity.  Several  crewmembers  suggested  that  one  reasonable  purpose  of  this 
mission  training  is  to  promote  joint  mission  operations  and  crew  resource  management  (CRM) 
principles,  as  applied  in  a  mission-oriented  simulator  training  format.  Thus  perceived,  it  was 
suggested  that  the  mission  debrief  should  be  explicitly  designed  to  relate  CRM  principles  and 
performance  to  the  crewmember’s  real-world,  joint  mission  operations  experience. 

Large  number  of  instructors  and  support  players  to  sustain  participant  crew  training.  SOFNET 
training  requires  almost  a  one-to-one  crewmember/instructor  ratio  to  support  this  training.  On 
the  surface,  this  may  not  seem  a  significant  point,  unless  one  considers  that  up  to  18 
crewmembers  may  be  trained  at  one  time.  It  was  suggested  that  this  is  a  very  resource-intensive 
operation  in  this  respect,  and  affects  other  resource  management  aspects  of  the  total  training 
system. 
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Using  instructors  as  role  players  adds  C2  realism  to  the  scenario’s  development.  Similar  to  the 
mission  brief,  it  was  suggested  that  the  mission  execution  phase  communications  requirements 
should  be  formally  scripted  and  integrated  in  a  real-time  format,  and  outside  agencies  (e.g., 
AWACS)  should  be  included  as  separate  role  players.  Specifically,  crewmembers  reported  tlwt 
they  woiild  incorporate  a  larger  mission  team  into  the  scenario  script,  to  include  (typical)  radio 
traffic  to  other  players  who  may  or  may  not  be  active  on  the  net.  They  suggest  that  file  primary 
advantage  to  such  an  approach  is  to  keep  the  communications  matrix  active,  and  the  aircrews 
invested  in  who  is  being  called  and  for  what  purpose.  Secondarily,  this  approach  would  tend  to 
promote  the  “fog-of-war”  concept  by  continually  providing  “ffistracters”  to  the  aircrews. 
Crewmembers  would  then  be  forced  to  actively  listen  and  make  decisions  based  on  information 
that  may  not  be  fully  accurate. 

Mission  Elements 

Dissimilar  representations  of  threat  environment  for  each  aircraft.  An  observed  problem  in  the 
lECSS  ne^ork  mode  is  that  different  aircraft  on  the  network  appear  to  have  different 
representations  of  the  threat  environment  (e.g.,  when  in  formation,  the  equipment  in  one 
helicopter  shows  no  threats,  while  another  indicates  a  missile  launch).  In  one  example,  the  MH- 
53J  Radar  Warning  Receiver  (RWR)  correctly  indicated  a  threat  where  programmed,  while  the 
MH-60G  (who  was  in  formation  with  the  MH-53J)  did  not  see  it  at  all  on  their  gear.  In  another 
case,  the  threat  was  represented  as  a  completely  different  threat  (requiring  a  different  tactic). 

Limited  emphasis  on  mission  planning  with  Special  Operations  Forces  Planning  and  Rehearsal 
System  (SOFFARST  The  heliwpter  crewmembers  are  provided  with  (minimal)  time,  following 
the  mission  in-brief  and  coordination  with  the  tanker  aircrew,  to  mission  plan.  Their  primary 
objective  for  the  morning  activities  is  to  attend  a  SOFPARS  training  class  that  lasts  over  two 
hours.  The  class  is  oriented  at  providing  an  introduction  and  overview  of  the  SOFPARS  system 
oiUy.  Conversely,  the  MC-130P  aircrew  has  a  great  deal  of  planning  time  to  calculate  their 
mission  plan.  SOFPARS  is  avmlable  for  their  use,  but  there  are  few  instructors  who  are 
proficient  enough  in  the  vagaries  of  the  system  to  effectively  demonstrate  this  mission 
preparation  method. 

Differences  in  NVG  vs.  daytime  mission  execution  protocols.  In  the  current  training  practice, 
instractors  are  allowing  their  crews  to  select  either  daytime  or  nighttime  conditions  for  their 
mission.  While  it  is  generally  accepted  that  AFSOC  crews  will  fly  in  NVG  conditions,  the  ACC 
crews  are  being  allowed  to  fly  in  daytime  conditions.  This  is  providing  an  unrealistic  advantage 
over  other  participants.  Secondarily,  the  aggressor  TH-53A  crew  is  provided  an  artificial 
advantage  by  performing  their  attack  maneuvers  in  daytime  conditions  while  at  least  one  of  the 
helicopters  is  operating  in  minimal  NVG  conditions. 

Discrepancy  between  ^TEL  information  and  threats  experienced,  ft  was  noted  that  INTEL 
mformation  provided  in  the  frag  is  not  what  the  mission  experiences.  Crewmembers  are 
subjected  to  varying  levels  of  threats,  depending  upon  their  instructor’s  personal  preferences. 
For  example,  the  MC-130P  crew  may  be  experiencing  no  threats  because  they  do  not  want  the 
lECSS  to  affect  the  mission  execution  (process);  or  the  MH-53J  that  is  operating  in  the  same 
database,  may  be  experiencing  a  large  volume  of  threat  activity  because  their  crew  possesses  a 
high  level  of  knowledge  on  threat  tactics.  Regardless,  there  seems  to  be  no  standardization  on 
how  the  threat  environment  will  be  scripted  for  each  participant  on  the  network. 

Excellent  opportunity  for  advanced  tactics  training.  There  is  an  apparent  consensus  among 
crewmembers  that  the  ability  to  encounter  threats  and  apply  tactics  in  a  real-time,  networked 
environment  is  a  simulation  training  advantage  that  cannot  be  replicated  in  the  aircraft.  It  was 
suggested,  however,  that  the  mission  script  should  include  a  greater  threat  saturation  level  for  all 
network  players.  Along  these  same  lines,  if  the  MH-53  A  is  to  be  represented  on  the  network  as  a 
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the  MC-130P?”  As  mentioned,  crewmembers  feel  that  the  threat  modeling  capabilities  of  the 
network  simulation  are  a  significant  advantage  over  standalone  training  because  live  threat 
encoimters  require  thinking  and  acting  in  real-time  to  the  unknown  attributes  of  combat 
adversaries. 

Disparate  knowledge  of  the  conduct  of  joint  mission  operations,  multiple  training  strategies,  etc. 
A  wide  disparity  with  respect  to  the  application  of  multiple  training  strategies  in  the  conduct  of 
training  for  joint  mission  operations  was  demonstrated.  While  an  instructor  may  have  a  high 
degree  of  knowledge  of  mission-specific  procedures  and  regulations,  and  perhaps  even  possess 
some  talent  at  simulator  systems  operation,  only  a  few  instructors  demonstrated  both 
qualifications.  Beyond  this,  the  ability  to  integrate  the  simulator  capabilities  into  flexible 
training  strategies,  coincident  with  the  mission’s  (vague)  outcome  objectives,  was  an  extremely 
complex  behavior  that  was  demonstrated  on  only  a  few  occasions. 

“Learning  Curve” 

This  section  documents  several  notable  observations  regarding  improvements  that  were 
made  to  the  SOFNET  training  system  and/or  methods  over  the  course  of  the  study  period.  The 
momentum  for  these  improvements  were  based  on  lessons  learned  from  session  to  session,  direct 
instructor  input/feedback,  and  observation  data  culled  from  the  primary  researcher  and  fed 
directly  back  to  the  responsible  development  personnel. 

Improved  quality  of  mission  briefings.  Over  the  course  of  the  observation  period,  the  MD 
continually  worked  to  enhance  the  mission  in-brief  Specifically,  this  person  continually  worked 
to  incorporate  information  regarding  real-world  aspects  of  mission  operations  into  the  mission 
in-brief.  At  the  beginning  of  the  observation  period,  the  in-brief  was  no  more  than  paper  notes 
that  the  MD  “read”  to  the  crews.  However,  by  the  end  of  the  observation  period,  the  in-brief  had 
progressed  to  high-quality  Powerpoint  slides  with  embedded  cartographic  and  objective  area 
photographs.  Additionally,  the  briefing  itself  had  progressed  to  include  several  operational 
factors  (e.g..  Intelligence,  Command  and  Signal,  CEOI,  etc.). 

Improved  ability  to  overcome  network  problems.  Soon  after  the  observation  period  began,  it 
became  evident  that  the  same  network  problems  were  being  encoimtered  on  a  session-to-session 
basis,  and  that  these  problems  were  simply  not  getting  fixed  (e.g.,  spontaneous  system 
“crashes,”  unrecoverable  loss  of  communications  channels,  etc.).  At  ftiat  time,  the  MD 
requested  support  from  TSG  to  provide  a  dedicated  individual  (technician)  to  sit  in  the  TOC  for 
the  length  of  each  SOFNET  training  session.  The  purpose  was  to  have  the  technician  observe,  in 
real  time,  the  problems  that  were  being  encountered,  the  conditions  leading  to  the  problems,  and 
Ae  attempts  to  apply  corrective  actions,  if  any.  'Hiis  individual  was  also  tasked  to  attend  an 
instructor-only  debrief  period  following  the  training  session,  where  lessons  learned  worxld  be 
shared  for  the  benefit  of  all  SOFNET  principals.  As  a  result,  solutions  and/or  new  procedures 
were  developed  to  overcome  several  problems,  and  the  network  failure  rate  was  significantly 
reduced. 

Improved  quality  of  mission  preparation  materials.  The  SOFNET  team,  from  the  beginning  of 
the  observation  period,  indicated  an  awareness  and  dissatisfaction  of  the  lack  of  adequate  mission 
preparation  materials.  Several  instructors  expressed  a  great  desire  to  personally  improve  the 
qiMity  of  these  materials,  but  were  faced  with  limitations.  First,  the  SOFNET  training  scenario 
was  under  continual  refinement  from  session  to  session  as  the  simulation  and  control  systems, 
training  methods,  and  imderstanding  of  joint  operations  training  improved.  This  warranted,  by 
necessity,  an  incremental  approach  to  materials  improvement,  and  thus,  instructors  were  asked 
only  to  provide  recommendations  for  improvement  to  the  MD.  The  MD  was  charged  with  the 
ultimate  and  sole  responsibility  of  developing  these  mission  preparation  materials,  yet  these 
could  not  be  developed  imtil  the  (previously  discussed)  higher  priority  network  systems 
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problems  were  dealt  with.  Once  the  network  problems  were  isolated  and  corrected,  the  MD,  with 
assistance  and  input  from  several  dedicated  instructors,  began  work  to  improve  the  mission 
preparation  materials.  The  result  was  a  significantly  enhanced  set  of  crew-tailored  mission 
packets  that  provided  extensive  mission  planning  and  mission  execution  data  (e.g.,  WX,  route 
details,  INTEL,  etc.) 

Improved  instructor  commtmications.  Very  soon  after  the  observation  period  began,  the  MD 
implemented  a  (scheduled)  one-hour  meeting,  attended  by  the  MD,  all  SOFNET  instructors  and 
TSG  personnel,  held  immediately  preceding  the  crew’s  arrival  at  the  simulator  for  their  mission 
execution  phase  of  trainmg.  There  were  several  reasons  stated  for  implementing  such  a  meeting. 
First,  it  was  noted  that  instructors  were  only  required  (and  scheduled)  to  be  present  for  training 
activities  when  their  crews  were  scheduled.  It  became  self-evident  very  quickly  that  instructors 
needed  training  in  TOC  systems  operation.  These  same  instructors,  who  are  fully  capable  of 
operating  their  WSTs/OFTs,  were  also  not  fully  aware  of  what  the  TOC  could  or  could  not  do  to 
affect  the  mission’s  process  or  outcome.  While  this  was  not  a  requirement  to  perform  the 
scnpted  operation,  it  was  detemiined  that  a  good  working  knowledge  of  how  the  TOC  operates 
and/or  is  limited  would  help  instructors  understand  where  work-around  solutions  to  problems 
may  need  to  originate.  Second,  and  as  previously  discussed,  instructors  needed  current  TD  and 
DR  listings  to  know  what  is  written-up.  This  meeting  facilitated  discussions  between 
maintenance  and  mstructors  to  determine  what  write-ups  had  been  cleared.  Finally,  the  meeting 
served  to  provide  a  source  of  discussion  on  conduct  of  joint  mission  operations,  multiple  training 
strategies,  etc.  This  served  the  purpose  of  inspiring  techniques  to  integrate  the  simulator 
capabilities  into  flexible  training  strategies,  coincident  with  the  mission’s  objectives. 

Survey  Results 

.  .  fhis  section  summarizes  results  of  the  surveys  completed  by  the  99  crewmembers  who 
participated  m  nine  SOFNET  missions.  The  first  subsection  describes  major  finHingg  from  the 
^alysis  of  the  quantitative  rating  data.  The  statistical  analyses  reported  are  based  on  the  raw 
data  table  presented  in  Appendix  B,  in  which  ratings  on  each  mission  element  from  each 
participant  are  tallied.  TTiese  data  are  organized  by  crews,  with  duty  position  and  weapon  system 
for  ^ch  crevmiember  hsted  m  the  column  heading.  The  second  subsection  presents  results  of  the 
analysis  of  the  qualitative,  comment  data.  These  analyses  are  organized  into  two  categories*  (1) 
responses  to  survey  questions  concerning  four  phases  of  the  SOFNET  mission:  in-brief 

planmng,  execution,  and  debrief,  and  (2)  supplemental  comments  on  the  33  mission  elements 
that  were  rated. 

Quantitative  -  Rating  Data 

Table  3  presents  the  mean  ratings,  averaged  across  all  crews  and  crewmembers,  for  the  33 
mission  elements  that  were  surveyed.  The  mission  elements  are  listed  in  descending  order  of 
ratmg,  with  the  element  name  preceded  by  the  item  number  that  appeared  in  the  survey 
T^e  third  column  mdicates  number  of  participants  (N)  who  responded  to  that  item.  Since  some 
elements  were  not  applicable  to  certain  crew  positions  and  weapon  systems,  the  total  N  is 
typically  less  than  99. 

1  As  seen  from  the  table,  all  elements  received  rather  high  ratings.  Even  the  lowest  rated 
element  Ch^Wi^  Procedures,  was  above  the  scale  midpoint  of  3.0.  To  determine  the  degree  to 
which  the  SOFNET  mission  elements  were  rated  positively,  we  compared  each  mean  against  a 
hypothetic^  vdue  of  3.0  using  a  t-test.  The  results  of  that  analysis  are  shown  in  the  right-most 
cohmm  of  Table  3.  The  equation  for  this  test  is:  t^  =  (M-3)/(S/vN),  where  N  is  the  number  of 
subjecte  responding  to  that  item,  M  is  the  mean  rating  of  the  item,  and  S  is  the  standard  deviation 
of  mjvidual  item  responses.  Asterisked  mission  elements  in  the  t-column  tested  statistically 
sigmficant  against  an  experiment-wise  alpha  level  of  .05,  based  on  a  nominal  alpha  of  0015  The 
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latter  is  derived  from  a  Bonferroni  adjustment  for  multiple  tests  (Harris,  1994)  corresponding  to 
EW  alpha  =  .05/33  =  .0015.  A  two-tailed  test  was  used,  where  depend-ing  on  the  N,  the  critical 
t-value  ranged  from  2.75  (for  N  <  40)  to  2.64  (for  N  >  80)  (Winer,  1972). 

As  evident  from  the  table,  all  but  two  mission  elements  were  rated  significantly  positive 
(i.e.,  above  the  scale  midpoint,  3.0)  by  SOFNET  crews.  Thus,  only  Airdrop  Operations  and 
Checklist  Procedures  failed  to  achieve  a  statistically  significant  rating.  Importantly,  overall  value 
of  networking  simulation  (element  #33)  was  rated  positively.  Note  that  this  test  w^  especially 
conservative  as  participants  were  only  allowed  to  assign  a  maximum  rating  of  “4.”  This  was 
because  we  felt  the  “  5”  rating  used  for  the  other  elements,  signifying  a  “networking  is  essentid 
for  this  element,”  was  not  a  logical  possibility  for  over^l  value  assessment.  Despite  this 
conservatism,  we  still  achieved  a  statistically  significant  positive  rating  for  the  overall  value. 
The  high  value  attriWed  to  networked  simulation  is  further  evidenced  by  the  fact  that  three 
participants  spontaneously  penciled  in  a  “  5”  on  their  survey  sheets  (though  they  were  counted  as 
“4”  in  our  analysis).  Hence,  it  is  clear  that  most  participants  felt  that  networked  CMT  represents 
a  substantial  benefit  over  traditional  standalone  training. 

An  interesting  trend  in  these  data  is  the  most  positively  rated  elements,  those  appearing  at 
the  top  of  the  table,  involved  coordination  among  multiple  players.  Indeed,  the  seven  elenients 
with  mean  ratings  of  4.0  or  higher  were  Multiship  Tactics,  Aerial  Refueling  (AR)  Operations, 
CSAR  Operations,  Formation  Flight,  Situation  Awareness,  Command  and  Control,  and  Mission 
Team  Coordination.  All  elements  require  integration  of  crew  efforts  to  be  successfully  completed 
and,  as  such,  their  positive  ratings  are  consistent  with  the  stated  purpose  of  network  training  to 
support  integrated  crew  operation;  it  is  also  consistent  with  the  crews’  general  comments. 

Table  3.  Crewmember  Mean  Ratings  of  Mission  Elements 
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Although  the  ratings  suggest  that  the  SOFNET  training  was  highly  valued  overall,  we 
probed  the  survey  rating  data  further,  to  ascertain  if  there  were  any  notable  differences  in  ratings 
across  crews,  weapon  systems,  and  crew  positions.  Figure  2  depicts  the  average  ratings  and 
overall  value  rating  for  each  of  the  nine  crews  that  were  surveyed.  For  each  crew,  we  derived  a 
single  average  rating  by  summing  the  ratings  across  all  crew  positions  and  all  mission  elements. 
To  determine  if  there  is  any  trend  in  crew  perceptions  of  the  value  of  networked  training  over 
time,  the  crews  have  been  numbered  chronologically.  In  addition,  we  have  put  the  number  of 
crewmembers  who  participated  in  the  mission  in  parentheses  (i.e.,  the  number  of  crew  positions 
that  occupied  WSTs  across  the  sessions). 


(10)  (11)  (7)  (10)  (13)  (7)  (12)  (17)  (10) 

Crew 

Figure  2.  Average  Mission  Element  Ratings  across  the  Nine  SOFNET  Crews. 


It  is  evident  from  the  figure  that  there  are  no  significant  trends  in  the  rating  data  over 
time.  For  example,  the  average  rating  of  the  32  mission  elements  (solid  circle)  varied  only 
between  4.1  and  3.5  across  all  nine  crews.  There  is  clearly  no  evidence  for  either  a  downward  or 
upward  trend  over  time  in  the  ratings.  While  the  average  ratings  for  the  overall  value  element 
were  more  vanable,  ranging  from  4.0  to  3.3,  it  too  showed  no  evidence  of  any  differences 
between  the  earliest  SOFNET  crews  and  the  later  ones. 


We  then  looked  at  the  average  rating  data  by  weapon  system,  collapsing  across  crews, 
crew  position,  and  mission  element.  Again,  we  have  a  separate  report  for  the  average  of  the  32 
mission  elements  and  the  33rd  rated  element,  overall  value.  We  retain  the  separation  since  we 
believe  the  two  items  are  tapping  fundamentally  different  perceptions  regarding  the  value  of 
networked  training. 


The  results  of  this  breakdown  are  shown  in  Figure  3  where  the  number  of  crewmembers 
who  p^cipated  in  the  training  is  indicated  in  parentheses.  Once  again,  we  see  no  evidence  of 
any  rating  differences  across  the  three  weapon  systems  for  either  the  overall  value  rating  or  the 
average  of  the  32  mission  elements.  The  lack  of  difference  is  somewhat  surprising  because  we 
had  suspected  Aat  the  MH-53J  crews,  by  virtue  of  having  the  scenario  tailored  to  their 
requirements,  might  have  a  more  positive  perception  of  the  networked  training  But  as  is  evident 
from  the  rating  data,  this  was  simply  not  the  case. 
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Figure  3.  Average  Mission  Element  Ratings  across  Weapon  Systems. 


Finally,  Figure  4  presents  the  average  rating  data  by  weapon  system  and  crew  position. 
In  contrast  to  the  two  previous  analyses,  the  data  in  this  figure  suggests  that  pilots  exhibited  a 
strong  preference  for  integrated  over  standalone  simulation  training  compared  to  their  non-pilot 
counterparts.  Moreover,  iMs  difference  is  evident  for  all  three  weapon  systems,  not  just  the  MH- 
53J,  and  is  more  apparent  for  the  overall  value  rating  than  for  the  average  of  the  32  mission 
elements. 


Crew  Position/Weapon  System 

Figure  4.  Average  Mission  Element  Ratings  by  Crew  Position  and  Weapon  System. 


To  assess  these  differences  statistically,  we  first  computed  the  average  standard  error 
about  the  mean  using  all  33  mission  elements  (including  Overall  Value).  This  value  was  .077. 
Multiplying  this  value  by  2.5  produces  a  99%  confidence  interval  (Cl)  that  can  then  be  applied  in 
a  series  of  mean  differences  tests  using  a  planned  comparison  methodology  (Hays,  1973).  The 
resulting  value  was  .193.  Placing  99%  CIs  of  this  size  around  each  mean,  we  see  that  significant 
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differences  are  obtained  between  MH-53J  pilots  and  non-pilots  overall  value  rating  (3.88  -  3.65  = 
.23)  as  well  as  between  the  MC-130P  pilots  and  non-pilots  (3.85  -  3.62  =  .23).  The  difference  for 
the  MH-60G  pilots  and  non-pilots  (3.85  -  3.67  =  .18)  just  missed  statistical  significance. 

Crew  Comments  on  the  Mission  Elements 

The  survey  booklet  contained  space  to  the  right  for  crewmembers  to  make  comments  on 
the  33  mission  elements.  Of  the  99  participants,  fully  one-third  (34%)  took  the  opportunity  to 
record  comments  on  the  survey  sheet  to  one  or  more  of  the  elements.  Their  responses  are 
presented  in  Table  4.  Within  each  element,  the  comments  have  been  organized  by  weapon 
system  and  duty  position.  To  facilitate  the  discussion,  we  organize  the  mission  elements  into  five 
higher  level  categories:  planning  and  briefings,  visuals  and  terrain,  tactics  and  operations, 
communications  and  procedures,  and  team  interactions.  The  elements  comprising  each  category 
are  listed  next  to  the  category  name. 


Table  4.  Supplemental  Crew  Comments  on  the  Mission  Elements  in  the  SOFNET  Survey 


1.  Mission  Planning 
(MP) 

Need  more  time  (to  integrate)  with  ail  players. 

53P  More  (MP)  time  would  be  useful. 

53 P  Were  some  mission  holes  (i.e.,  IMOM  product  w/threats  degraded,  LZ  with 

incoirect  coordinates,  incomplete  terminal  ops  data  (imagery,  etc.) 

53 P  Mission  was  already  planned  (too  much  preplanning  done). 

53P  SOFPARS  maps  are  (unusable).  Need  to  use  real  mission  charts. 

53FE  Allows  flying  crews  to  do  more  of  the  plan. 

53FE  AH  crew^crewmembers  need  to  all  be  present  at  the  same  time. 

60FE  Crews  should  have  had  more  time  to  mission  plan. 

60FE  MP  is  useful  for  familiarization  with  how  other  crews  plan;  but  is  it  realistic? 

53P  Forces  Helo  andfShado  crews  to  discuss  tactics  in  threat  environment 

53P  Aacceptable  for  scenario. 

53P  Would  be  better  if  more  crew  interaction  time  were  provided. 

53FE  Allows  flight  crews  to  do  more  of  the  plan. 

60?  Useful  for  familiarization  w/how  other  crews  do  tactics;  but  is  it  realistic? 

53 P  More  time  needed. 

60FE  Useful  for  familiarization  w/how  other  crews  brief;  but  is  it  realistic? 

■■ 

53P  Was  planned  tor  us. 

53 P  Need  to  plan  w/60  crew. 

60P  Need  a  map,  not  20  pages  of  AFMSS/SOFPARS/IMOM. 

60FE  Useful  for  familiarization  w/how  other  guys  do  it;  but  is  it  realistic? 

130CSO  I  don’t  plan. 

■ 

53P  Hard  to  tly  multiship  at  low  illumination. 

53  P  Excellent. 

53FE  All  players  should  be  same,  day  or  night. 

60P  Graphics  were  disorienting  and  terrain  was  hard  to  make  altitude  judgments, 

60P  Got  pretty  dark  a  few  times. 

60FE  Use&l  for  familiarization  w/how  other  crews  do  it;  but  is  it  realistic? 

130CSO  1  was  in  the  SNS. 

1 30CSO  Docs  not  matter  for  RO  position. 

o.  Low  Altitude 

Operations 

53P  1  crrain  ditticult  to  see. 

53FE  You  have  to  take  into  account  others’  capabilities. 

60P  Graphics  were  disorienting  and  terrain  was  hard  to  make  altitude  judgments. 

60FE  Useful  for  familiarization  w/how  other  crews  do  it;  but  is  it  realistic? 

1 30CSO  Docs  not  matter  for  RO  position. 

7.  Kadar/PLIK 

Interpretation 

53Pt;  Radar  went  out  too  much. 

60P  Useful  for  familiarization  w/how  other  crews  do  it;  but  is  it  realistic? 

60P  FLIR  was  a  must  to  see  lead  in  some  of  the  terrain. 

1 30P  FLIR  picture  today  was  terrible. 

130P  Radar  does  not  work  as  well  networked. 

130CSO  Docs  not  matter  for  RO  position. 

130Nav  Liked  real  helo  with  real  people. 
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Table  4.  Supplemental  Crew  Comments  on  Mission  Elements  in  the  SOFNET  Survey  (Cont’d) 


8.  Secure 

Communications 

53F  Stili  not  good. 

53P  Need  SATCONWHF  secure. 

53P  No  pretending  in  network. 

53FE  Just  like  the  real  thing-bad  communications. 

53 FE  Didn’t  like  it;  need  real-world  high  priority  with  multiple  problems. 

60P  Poor  rating;  need  to  practice  using  secure. 

60FE  Useful  for  familiarization  w/how  other  crews  do  it;  but  is  it  realistic? 

l30Nav  Face  to  face  with  customer  is  important  for  comm  and  tactics. 

130CSO  Realistic. 

130CSO  Not  realistic. 

130CSO  Didn’t  do  real  secure. 

53FE  Not  knowing  the  position  degrades  multiship. 

60FE  Need  better  brief  w/understanding  of  Pave  Low  capabilities. 

13  OP  Does  this  question  beg  an  answer 

130CSO  For  RO  position  it  doesn’t  matter  if  we’re  networked  or  standalone  because  of 
our  crew  position  in  the  SNS  (this  applies  to  all  elements). 

10.  I'hreatlDand 

Response 

53P  Some  threat  indicators  were  false. 

53FE  Not  good;  recommend  dedicated  1/2  sortie  for  this. 

60P  Liked  this;  don’t  know  how  often  this  gets  accomplished  by  day-to-day  flying. 

130P  Too  many  delays  compared  to  standalone. 

1 1 .  CSAK  Operations 

53P  Vety  realistic. 

53 FE  Need  to  look  at  threat  responses  in  dissimilar  A/C  (is  a  criticism). 

60P  Didn’t  really  do  this  today. 

60P  Not  done. 

60P  This  was  a  special  operation. 

60FE  Problem  solving:  how  can  we  pick  up  these  guys  when  we’re  overloaded? 

53P  Excellent 

60FE  Negative  ratings  are  because  for  me,  I  was  cut  out  of  much  of  the  scenario 

because  of  ICS  limitations.  If  we’re  going  to  play  the  game,  let  everyone  on 
the  crew  in  the  game.  Had  this  been  die  case,  my  opinion  might  have  been 
better  (this  applies  to  elements  12-25). 

33P  Jkietter  if  two  can  direct  response. 

53FE  Not  sure;  waiting  for  gunner  sim. 

60FE  The  gunner’s  sim  would  greatly  enhance  this. 

130P  We  never  work  alone  (positive  comment). 

MBomm 

53P  Never  got  there 

53FE  More  hose  pressure  from  tanker 

53P  beems  too  sensitive. 

53P  Outstanding! 

53P  Caused  sic&ess  and  pain. 

53P  Worthless. 

53FE  Unrealistic/computer  problems  with  lights. 

60P  Much  more  realistic. 

60P  Real  tough  to  do;  can’t  see  tanker  on  right  hose  from  right  seat. 

60P  Tough  to  AR  in  die  sim. 

ISONav  Lik^  real  helo  with  real  people. 

None. 

wmm 

~57P  We^er^always  lead. 

53P  Very  hard  to  determine  closure  rate. 

53FE  As  lead,  unable  to  see  formation. 

60P  Graphics  were  disorienting  and  terrain  was  hard  to  make  altitude  judgments 

18.  In-Flight  Problem 

Solving 

“53P  Great! 

53FE  Excellent  scenario;  realistic! 

60P  Must  include  more  variables. 

60P  Sim  is  great  place  to  solve  problems. 

130P  Liked  having  random  requests  come  in  that  required  working  with  other  team 

members  to  solve  them. 

1 3 ONav  The  opportune  AR  was  realistic. 

19.  threat 

Avoidance/Evasion 

5 3 P  better  it  two  can  direct  response. 

53P  Great! 

53FE  Not  many  threats. 

None. 
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Table  4.  Supplemental  Crew  Comments  on  Mission  Elements  in  the  SOFNET  Survey  (Concluded) 


2 1 .  iiiystcms  Maltunctions 

53P  Better  because  ot  other  players’  inputs 

53  P  Other  crews  can  support 

53FE  Outstanding!  made  us  work  but  left  us  a  way  out 

60P  Sim  is  great  place  to  solve  problems 

60P  Must  include  more  variables. 

53 P  Other  aircraft  help  to  keep  bA,  especially  in  threats. 

53 FE  Flight  lead’s  tactic  may  depend  upon  formation  position. 

We  can’t  see  behind  us. 

53FE  Enhances  greatly. 

filHi 

53hE  blight  lead’s  tactic  may  depend  upon  formation  position. 

We  can’t  see  behind  us. 

130CSO  We  were  rushed  because  it  was  after  1700. 

25.  Command  &  Control 

53P  Gets  more  complicated. 

53FE  Flight  lead’s  tactic  may  depend  upon  formation  position. 

We  can’t  sec  behind  us. 

53FE  Excellent  coordination;  some  A/C  slow  to  respond 

26.  Minimum  Wx 

Operations 

53P  Can  be  detnmental  it  other  aircraft  not  l  h/ 1  A. 

60FE  Need  better  brief  w/understanding  of  Pave  Low  capabilities. 

53FE  Ideally,  we  want  poor  Wx  (more  simulations). 

28.  Intil/txtil  Operations 

53  P  Must  work  with  other  aircraft. 

53FE  Need  to  make  fuel  flow  realistic  during  mission. 

130Nav  Realistic  because  helos  actually  have  need  for  gas. 

30.  Chatt/Flare 

Management 

53P  Must  coordinate  who  expends. 

53P  We  lost  all  our  chaff  for  no  reason. 

53FE  Need  to  look  at  tanker/helo  AR  flare/chaff  (liked  this). 

60FE  Need  better  brief  w/understanding  of  Pave  Low  capabilities. 

53P  Great  interaction  and  learning  after  joint  practice. 

130Nav  Again,  face  to  face  is  better  than  simulation. 

5iP  Need  role  player’s  aircratt  as  the  ground  team,  etc.,  to  keep  the  training  realistic 

inside  the  aircraft. 

53PE  Better,  but  not  that  spectacular;  keep  working,  it  will  be  excellent! 

Planning  and  Briefings  (MEs  1, 2, 3, 4, 31) 

A  number  of  participants  cited  the  need  for  more  time  to  conduct  planning.  They  also 
indicated  dissatisfaction  with  the  computerized  SOFPARS  maps,  preferring  instead  paper  maps. 
Though  it  did  not  always  happen,  the  crews  liked  having  everyone  get  together  at  the  start  of  the 
mission  as  it  helped  them  become  familiar  with  dissimilar  aircraft  issues.  In  addition,  some  crew 
positions  reported  little  involvement  in  planning,  such  as  the  CSO  on  the  MC-130P.  However, 
this  appears  to  be  more  an  issue  of  typically  assigned  crew  duties  raAer  than  integrated  simulator 
training.  There  were  mixed  comments  regarding  the  realism  of  the  scenario,  with  the  prevailing 
view  that  it  was  acceptable  given  the  types  of  tactics  being  tr^ed  But  as  one  participant  noted, 
“  face  to  face  is  better  than  simulation”  indicating  the  need  for  group  interactions  both  before  and 
after  the  mission. 

Visuals  and  Terrain  (MEs  5, 6, 7, 16) 

Crew  comments  were  mixed  regarding  the  quality  of  simulator  visuals  and  terrain. 
Several  pilots  reported  having  difficulty  seeing  the  terrain  while  flying  low  level.  This  is 
undoubtedly  related  to  the  illumination  level  used  in  the  mission.  Also,  there  were  some 
complaints  regarding  the  operation  of  the  radar  and  FLIR,  with  several  pilots  reporting  that  it  dd 
not  work  as  well  when  networked.  As  well,  some  pilots  reported  that  the  graphics  were 
“disorienting”  and  the  terrain  “difficult  to  see.”  One  pilot  commented  that  all  WSTs  should 
have  the  same  visual,  day  or  night,  which  was  not  always  done  in  the  SOFNET  missions. 
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Tactics  and  Operations  (MEs  9,  10, 11, 12, 13,  14, 15, 17,  19, 26, 28, 29, 30) 


This  category  encompassed  a  number  of  diverse  mission  elements.  Tactics  involving 
threats  received  mixed  reaction,  with  some  participants  citing  the  lack  of  realism  while  others 
touting  the  value  of  practice  that  is  not  always  possible  back  at  the  squadron.  Regarding 
weapons  employment,  there  is  clearly  a  consensus  that  realism  will  be  greatly  enhanced  once  the 
AGSS  comes  on  line.  In  a  comment  that  is  equally  relevant  to  the  preceding  category,  formation 
flight  seemed  to  pose  problems  for  several  crews  due  to  insufficient  quality  of  die  visuals.  In 
addition,  several  crews  commented  that  fuel  and  expendable  management  would  be  improved  if 
there  were  more  extensive  briefings  on  the  capabilities  of  dissimilar  aircraft.  There  was 
considerable  negative  reaction  to  the  AR  part  of  the  mission.  Some  participants  cited  problems 
in  seeing  the  tanker  while  others  thought  the  hose  pressure  was  unrealistic.  As  discussed 
elsewhere  in  the  report,  there  is  a  larger  problem  concerning  the  master/slave  relationship  with 
the  networking,  and  how  instructors  can  work  together  to  control  the  simulation  environment. 

Communications  and  Procedures  (MEs  8, 20, 21) 

One  of  the  most  frequently  cited  problems  concerned  the  inability  to  achieve  secure 
communications  during  the  networked  mission  which  many  believed  hurt  the  overall  realism  of 
the  scenario.  Despite  &s  problem,  one  participant  indicated  that  these  communication  problems 
were  actually  good  training  strategy  since  it  mirrored  what  is  foimd  during  actual  operations. 
Interestingly,  several  crewmembers  cited  some  value  added  that  networking  provides  for  systems 
malfunctions  training  as  it  permits  a  crew  to  get  inputs  from  another  team.  The  lack  of 
comments  for  Checklist  Procedures  is  consistent  with  the  low  rating  that  this  element  received. 

Team  Interactions  (MEs  18, 22, 23, 24, 25, 32) 

As  expected,  the  bulk  of  the  positive  crew  comments  fell  imder  the  category  of  what  may 
be  called  “team  interactions.”  A  number  of  participants  stated  that  the  networkhig  environment 
was  an  excellent  place  to  attempt  different  solutions  to  problems,  although  one  pilot  felt  that 
more  complex  variables  should  be  included  in  the  scenario.  Several  expressed  Ae  belief  that 
crew  situation  awareness  is  enhanced  by  having  other  players  present  in  the  scenario,  particularly 
with  regard  to  tactics  employment  in  the  threat  environment.  Although  rating  data  support  the 
crews’  overall  high  assessment  of  the  training  potential  for  networked  simulation,  one  helicopter 
pilot  noted  that  it  is  important  for  the  instructors  or  role  players  to  keep  the  script  “realistic” 
inside  the  aircraft.  This  issue  will  be  further  discussed  in  a  later  section,  when  we  offer  some 
recommendations  for  improving  the  SOFNET  training  method. 

Qualitative  Comment  Data  -  Responses  to  Networked  Training  Questions 

The  first  page  of  the  SOFNET  survey  asked  participating  crewmembers  four  questions 
concerning  their  perceptions  of  the  value  of  networked  training.  Each  question  pertained  to  a 
popular  phase  of  the  training  session.  The  first  question  addressed  the  value  of  the  crew 
mission  briefing.  The  second  question  assessed  crewmembers’  perceptions  of  the  realism  of  the 
mission  script.  A  third  question  probed  different  ways  that  the  mission  plan  might  have  changed 
as  a  result  of  interactions  with  other  team  members.  The  fourth  question  asked  crewmembers  to 
estimate  the  likely  impact  of  networked  training  on  real-world  mission  success.  Finally^  space 
was  provided  on  the  survey  for  crews  to  note  any  additional  comments  they  might  have 
concerning  the  value  of  networked  training. 

Overall  level  of  responsiveness  to  the  survey  itself  was  quite  impressive.  All  99  crew¬ 
members  took  time  to  comment  on  virtually  all  of  the  questions.  Indeed,  of  the  396  opportunities 
to  make  comments  (i.e.,  4  questions  by  99  participants),  376  (95%)  of  the  response  slots 
contained  comments.  Moreover,  though  not  required,  almost  half  of  the  participants  (48)  took 
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the  opportunity  to  record  additional  comments  in  the  space  provided.  Viewed  as  a  whole,  the 
high  level  of  crew  responsiveness  to  the  SOFNET  survey  speaks  not  only  to  their  desire  to  have 
direct  input  into  the  future  directions  of  networked  training,  but  in  their  confidence  that  their 
comments  will  be  seriously  considered  by  the  58  TRSS.  The  result  is  a  substantial  database  of 
highly  insightful  and  detailed  comments  that  delineate  many  of  the  strengths  and  weaknesses  of 
networked  training  as  presently  practiced  at  Kirtland  AFB. 

In  the  following  subsection,  we  summarize  the  crew  responses  to  each  of  the  four 
questions.  For  each  question,  a  commonality  analysis  was  performed  in  which  the  most  common 
responses  were  tallied,  distilled,  and  rendered  as  a  modal  response.  The  raw  comment  data  on 
which  this  analysis  is  based  are  presented  in  Appendix  B.  As  seen  there,  the  data  are  organized 
by  crew,  with  responses  to  the  five  (including  additional  comments)  questions  forming  the 
columns. 


Question  1:  How  clear  was  your  specific  role  as  a  network  player  in  the  mission  script  once 
the  in-brief  ended?  What  might  have  been  done  during  the  in-briefing  to  help  clarify  your  role 
or  requirements? 

For  the  most  part,  the  SOFNET  crews  indicated  their  specific  role  was  fairly  clear  from 
the  briefing.  A  typical  response  to  this  question  was  that  it  was  “mostly  clear  except  for  ...  ” 
The  response  that  followed  tended  to  vary  across  crews,  reflecting  minor  changes  that  the 
instructors  made  to  the  mission  script  over  the  course  of  the  SOFNET  study.  For  the  10 
members  of  Crew  #1,  everything  was  clear  in  the  mission  in-brief  except  “that  no  h-hour 
established.  The  lack  of  a  specific  time  for  this  action  made  it  difficult  for  crews  to  incorporate 
time  deviations  and  other  “  what-if  ’  type  of  factors  into  their  plan. 

regard  to  Crew  #2,  several  factors  were  mentioned  as  missing  from  the  in-brief, 
although  4  of  the  11  crew  members  were  content  with  the  in-brief  as  given.  Of  the  in-brief 
factors  that  were  critiqued,  toee  crewmembers  indicated  that  more  mission  planning  time  should 
have  been  allotted.  In  addition,  one  crewmember  noted  that  the  “comm  package  was  weak  ”  and 
one  participant  stated  that  the  ATO/SPINS  did  not  provide  enough  supporting  materials  for 
backend  crewmembers  to  formulate  an  evasive  plan  of  action  (EPA). 

Crew  #3’s  responses  to  this  question  were  quite  varied.  Two  of  the  seven  crewmembers 
were  content  with  the  m-brief  presentation.  One  of  the  FEs  criticized  the  limited  role  his  crew 
position  played  in  the  mission  as  a  whole.  Two  others  cited  the  lack  of  explicit  rules  of 
engagement  (ROE)  in  the  in-brief  as  well  as  the  very  limited  imagery  available  in  the  objective 
area.  Fmdly,  one  MH-60G  pilot  felt  that  the  capabilities  of  the  H-60  were  not  sufficiently 
addressed  dunng  the  m-brief 

All  12  members  of  Crew  #4  were  complimentary  of  the  mission  in-brief  There  were 
only  two  suggestions  for  improvement.  One  crewmember  indicated  that  a  better  discussion  is 
needed  on  the  intentions  of  the  ground  forces  in  the  LZ.  Another  member  suggested  that  a 
FRAG  sheet  should  be  provided  that  puts  all  the  key  mission  data  on  the  crew’s  kneeboard. 

Crew  #5  was  equally  complimentary  of  the  mission  in-brief  All  13  crewmembers  cited 
the  clanty  and  detail  of  the  in-brief  Nevertheless,  two  crewmembers  suggested  that  more 
planmng  time  be  provided.  In  addition,  one  crewmember  recommended  that  an  EPA  be 
incorporated  into  the  plan  whereas  another  participant  cited  the  need  for  “better  charts  ” 


Similarly,  all  seven  members  of  Crew  #6  commented  on  the  adequacy  and  sufficiency  of 
the  mission  in-brief  In  fact,  none  of  the  participants  from  this  crew  indicated  a  need  for  any 
additional  information. 
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Ten  of  the  12  members  of  Crew  #7  expressed  a  positive  response  that  the  mission  in-brief 
was  clear.  Two  participants  noted  that  the  mission  plan  could  be  improved  by  incorporating  an 
ATO  into  the  briefing  package. 

Sixteen  of  the  17  members  of  Crew  #8  were  pleased  with  the  information  that  was 
presented  in  the  mission  in-brief.  Only  two  additions  were  cited  as  necessary.  One  crew¬ 
member  indicated  a  need  for  additional  charts  of  the  objective  area.  A  second  participant,  an 
MH-53  pilot,  commented  that  additional  information  on  aircraft  weapon  capabilities  would  be 
helpful  during  the  in-brief 

Finally,  all  ten  members  of  Crew  #9  responded  that  their  required  roles  were  made  very 
clear  during  the  mission  in-brief  Only  one  participant,  an  MC-130  pilot,  noted  that  some 
additional  directions  fi'om  the  mission  commander  (e.g.,  3 -engine  airdrop  requirements)  should 
have  been  incorporated  into  the  mission  in-brief  and  mission  plan. 

Question  2:  Were  there  aspects  of  the  mission  script  that  required  you  to  support  the  actions  of 
another  crew  that  were  artificial  or  unrealistic? 

An  impressive  two-thirds  of  the  participants  (67)  responded  that  the  mission  script  did  not 
require  them  to  perform  in  artificial  or  unrealistic  ways  in  order  to  support  crewmembers  from 
another  WST.  This  result  suggests  that  the  SOFNET  mission  script  struck  a  fairly  even  balance 
between  establishing  the  objectives  for  an  actual  combat  mission  while  ensuring  that  each 
participating  weapon  system  had  some  meaningful  tactical  tasks  to  perform  during  die  four-hour 
mission. 

On  the  other  hand,  one-third  of  the  crew  members  we  surveyed  responded  with  one  or 
more  critiques  concerning  the  unrealism  of  the  mission  script.  These  critiques  fell  into  one  of 
five  categories:  simulator  capabilities,  mission  conditions,  terminal  area  tactics,  role  playing,  and 
mission  objectives. 

With  regard  to  simulator  capabilities,  five  of  the  participants  noted  that,  although  the 
demands  of  the  mission  required  that  the  MH-60G  have  the  more  capable  70 1C  engine  (which  is 
in  the  actual  aircraft),  the  WST  has  the  less  powerful  700  engine  in  die  aero  package.  The  result 
was  an  inability  to  perform  the  required  aerial  refueling  on  a  consistent  basis.  Another  comment 
that  several  crewmembers  made  was  the  distraction  caused  by  hearing  the  “admin  traffic” 
between  the  instructor  pilots  (IPs)  in  the  different  WSTs.  In  addition,  al^ough  many  participants 
believed  that  having  to  use  the  XJHF  radio  for  the  command  net  added  to  the  mission’s  realism, 
one  crewmember  considered  it  “artificial.”  Moreover,  one  MH-60G  pilot  noted  that  having  a 
real-world  database  would  improve  the  realism  of  the  tactical  coordination  required  with  the 
MH-53  J  weapon  system. 

Perhaps  the  most  significant  criticism  in  this  category  involved  the  fact  that  the  MC- 
130P,  MH-53J,  and  MH-60G  WSTs  “did  not  have  the  airspeed  comparisons  that  matches  the 
aircraft.”  This  mismatch  required  that  the  MC-130P  fly  close  to  stall  speed  while  performing 
ARs  with  the  helicopters.  As  one  helicopter  pilot  noted,  this  made  the  plaimed  AR  only 
“marginally  realistic.”  Moreover,  one  MH-53  J  FE  noted  that  while  the  script  was  “very  good 
and  well  thought  out,”  the  mission  would  probably  use  two  MH-53  Js. 

With  regard  to  mission  conditions,  a  related  problem  that  four  participants  cited  was  the 
unrealism  of  the  original  temperature  and  density  altitude  parameters  within  the  LZ  given  the 
limited  power  available  for  the  MH-60P.  One  helicopter  pilot  indicated  that  they  had  to  “lower 
the  temperature”  in  order  to  perform  the  required  pick-up.  Another  factor  that  was  reported 
concerned  the  MC-130P’s  requirement  to  penetrate  a  high-threat  area  in  order  to  perform  the 
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airdrop.  While  several  participants  cited  the  unrealism  of  this  requirement,  they  also  noted  that  it 
was  good  training  and  “  lots  of  fun”  given  the  briefed  threat  scenario. 

Within  the  terminal  area,  several  tactical  aspects  of  the  mission  were  criticized.  First, 
one  MH-53P  pilot  felt  that  the  indications  from  one  of  the  SAM  sites  was  “bogus.”  In  addition, 
several  of  the  MH-53J  crewmembers  critiqued  the  use  of  secure  radios  during  calls  for  fire 
support.  Instead,  they  noted  that  for  real-world  operations,  the  calls  would  be  “in  nonsecure 
mode  for  quick,  cle^,  and  concise  communications.”  As  well,  one  of  the  MC-130P  pilots  stated 
that  the  threat  level  in  the  DZ  was  too  high  for  the  tactical  requirements  of  their  weapon  system. 
One  of  the  MH-60G  pilots  expressed  disbelief  that  under  real-world  conditions  they  would  have 
been  able  to  insert  two  Special  Forces  (SF)  teams  at  the  same  time. 

Several  aspects  of  the  role  playing  required  during  the  SOFNET  mission  were  criticized 
as  needing  further  improvement.  First,  one  of  the  crews  had  experienced  problems  with  then- 
visual  system,  wWch  forced  them  to  “role  play”  more  of  the  scanners’  fimctions.  Also,  the  lack 
of  wraparound  visuals  in  the  WST  gave  them  less  scanning  capability  than  they  would  have  in 
the  aircraft.  Second,  one  MC-130P  pilot  noted  that  it  was  unrealistic  to  drop  the  SF  team  to 
secure  the  FARP/transload  site  given  the  threat  level  in  the  area.  Third,  several  non-SOF  pilots 
from  the  Search  and  Rescue  (SAR)  squadrons  critiqued  the  unrealism  of  supporting  an  infil/exfil 
mission.  On  the  other  hand,  they  also  lauded  the  unusual  training  they  received  as  a  result. 

Finally,  the  SOFNET  mission  objectives  were  criticized  by  several  of  the  participants. 
On  the  one  hand,  several  MC-130P  pilots  noted  that  one  of  the  required  helo  ARs  was  unrealistic 
given  the  threat  level  in  the  DZ.  Moreover,  another  MC-130P  pilot  complained  about  the  lack  of 
a  role  player  in  the  scenario  whose  inputs  would  “affect  our  (MC-130P)  decision  maVing 
realism.”  In  addition,  several  pilots  doubted  that  both  the  MH-60G  and  MH-53J  would  be  able 
to  fit  into  the  terminal  area  to  drop  the  SF  team  in  the  building. 


Question  3:  In  what  ways  did  your  mission  plan  change  as  a  result  of  interaction  with  other 
mission  team  players?  What  team  interactions  were  helpful  or  not  helpful?  What  other  team 
interactions  would  have  made  the  training  more  realistic? 

The  vast  majority  of  the  survey  participants  responded  to  one  or  more  parts  of  this 
question.  With  regard  to  mission  plan  changes  prompted  by  team  interactions,  four  changes  were 
cited  most  often,  all  of  which  were  considered  positive  from  a  training  impact.  The  specific 
change  to  the  plan  varied  across  crews,  reflecting  minor  modifications  to  the  mission  script 
imposed  by  the  instructors. 


AT/-.  f^®''^®®bers  lauded  the  training  benefits  associated  with  having  to  slip  the 

MC-130P  s  /^^CT  because  of  the  late  takeoff  time  by  the  helos.  Second,  the  nature  of  the  AR 
(i.e.,  orbit  pomt,  track)  had  to  be  changed  due  to  the  helo  “going  single  engine.”  Third,  one  of 
the  helicoptCT  CTews  noted  that  they  had  to  change  their  planned  ingress  after  diverting  to  pick  up 
a  downed  fflND  crew.  Fourth,  another  crew  had  to  alter  its  plan  in-flight  in  order  to  perform  an 
unplanned  AR.  In  all  cases,  these  changes  to  the  mission  plan  were  viewed  favorably  since  they 
are  very  helpful  for  coordinating  with  other  aircraft.” 

Participant  response  to  the  second  part  of  the  question,  the  nature  of  the  team  interactions, 
contamed  a  mix  of  positive  and  negative  viewpoints.  On  the  positive  side,  a  number  of  MH-60G 
crewmembers  lauded  the  opportunity  to  meet  face  to  face  with  the  MH-53J  crews,  thereby 
learning  more  about  the  limitations  of  the  Pave  Low  weapon  system.  In  a  similar  vein,  one  crew 
expressed  a  positive  reaction  to  having  a  “face  to  face”  with  members  from  the  other  WSTs  to 
compare  specific  elements  of  their  plans,  such  as  initial  points  (IPs),  control  points  (CPs),  infil/ 
exfil  coordinates,  ^d  minimum  srfe  altitudes  (MSAs).  In  addition,  a  number  of  crewmembers 
expressed  the  feeling  that  interactions  between  the  tanker  and  helos  during  the  AR  were  very 
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useful  for  training,  and  were  certainly  superior  to  “having  instructors  insert  moving  models”  into 
the  database.  Moreover,  the  crews  were  uniformly  positive  about  the  traiimg  benefits  of  the 
manned  HIND  aggressor’s  (played  by  an  instructor  in  the  53 A  OFT)  impact  on  the  two 
helicopters’  ingress  route  and  en  route  times. 

On  the  negative  side,  several  MH-60G  FEs  commented  on  the  limited  capability  for 
effective  communications  during  parts  of  the  mission.  In  a  similar  vein,  crews  from  all  WSTs 
commented  on  distractions  posed  by  the  audible  team  interactions  over  the  intercom.  As  well, 
crews  that  contained  a  mix  of  AFSOC  and  ACC  CSAR  crewmembers  indicated  that  more  face- 
to-face  time  was  needed  in  order  to  clarify  differences  in  terminology,  procedures,  and  tactics. 

Finally,  a  number  of  survey  respondents  provided  very  clear  and  insightful  comments 
regarding  other  team  interactions  they  would  like  to  see  incorporated  into  the  SOFNET  mission 
scenario.  Foremost  among  the  possible  changes  to  the  SOFNET  scenario  is  the  need  for  more 
planning  time  to  iron  out  differences  in  procedures  (e.g.,  formation  lights,  comm  out)  between 
the  MH-53J  and  MH-60G  weapon  systems.  As  part  of  this  change,  several  crewmembers 
recommended  that  some  general  planning  time  be  allocated  so  that  the  crewmembers  from  all  the 
WSTs  can  “  get  together  to  iron  out  differences.”  In  addition,  some  face-to-face  time  prior  to  the 
briefing  would  also  be  useful  and  would  “more  realistically  simulate”  the  activities  of  a 
Joint  Special  Operations  Command  (JSOC)  exercise. 

Agencies  that  were  cited  as  needing  to  be  role  played  in  the  scenario  include  ABCCC, 
SOCHQ,  and  AWACS.  Several  crewmembers  indicated  a  need  to  have  more  threats  located  in 
the  en  route  phase  of  the  mission.  Another  crewmember  recommended  a  ground-team,  scripting 
sheet  be  developed  to  guide  activities  within  the  LZ  and  objective  area.  Fi^ennore,  sever^ 
helicopter  pilots  expressed  the  need  to  have  the  aerial  gunners/scaimers  participate  in  training  as 
the  lack  of  scanners  seriously  increases  pilot  workload.  This  capability  will  be  available  once  the 
AGSS  has  been  placed  on  the  SOFNET  node  and  integrated  wi&  the  other  WSTs. 

Question  4:  How  is  training  in  a  joint  networked  simulation  mode  likely  to  affect  your  real- 
world  chances  for  mission  success?  Which  areas  of  the  mission  are  most  likely  to  be  affected? 
Please  explain. 

All  but  four  of  the  survey  participants  responded  to  this  question.  With  regard  to  the  first 
part  of  the  question,  respondents  were  uniformly  positive  regarding  the  effect  of  networked 
simulation  on  perceived  chances  for  mission  success.  In  fact,  only  4  of  the  95  participants  who 
responded  to  this  question  expressed  negative  sentiments  concerning  the  effect  of  networked 
training.  Comments  like  “not  likely  to  affect  role  personally  as  an  FE”  are  typical  of  this 
minority  viewpoint. 

For  the  91  participants  who  lauded  the  effect  of  networked  training,  a  wide  range  of 
insightful  and  exciting  opportunities  for  improving  mission  success  was  stated.  One  of  the  most 
frequently  cited  comments  (15)  was  that  the  SOFNET  training  has  the  potential  to  simulate  the 
“fog  of  war”  through  creation  of  inadvertent  malfunctions  and  the  inevitable  “technical 
glitches”  that  occur  when  multiple  systems  are  tied  together.  As  such,  it  serves  as  a  valuable  MR 
tool  that  allows  crews  to  practice  techniques  and  tactics  not  possible  in  JRTs  or  other  live 
exercises. 

Another  impact  area  that  was  mentioned  concerns  the  capability  of  the  networked 
simulation  to  promote  the  practice  and  honing  of  key  tactical  skills.  Twelve  participants 
responded  with  examples  in  this  category,  including  such  tactics  as  EPs,  bump  plans,  single 
engine  maneuvers,  and  AR.  With  regard  to  AR,  subareas  that  would  likely  be  facilitated  include 
selecting  alternate  tracks  and  altitude  in  the  event  of  bad  weather,  doing  more  realistic  “pop-up 
ARs,”  and  scheduling  ARs  before  or  after  insertions. 
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A  third  area  that  was  reported  as  receiving  a  boost  from  networked  simulation  was  C2. 
Thirteen  participants  provided  responses  in  this  category.  Typical  responses  included  such 
benefits  as:  improved  “comm  planning,”  exposing  communications  as  the  “weak  link”  in  the 
plan,  teaching  communications  between  the  joint  commands  and  their  different  ways  of 
operating,  teaching  commanders  who  will  become  AMCs,  instilling  “flexibility”  in  C2 
interactions,  developing  the  “big  picture  orchestration,”  seeing  how  comm  changes  impact  the 
mission  plan,  observing  the  impact  of  “lost  comm”  on  mission  outcome,  and  reaffirming  the 
mandatory  comm  channels. 

A  fourth  area  that  would  benefit  from  networked  training  involves  learning  the 
capabilities  and  limitations  associated  with  dissimilar  platform  operations.  Eight  participants 
provided  responses  in  this  category.  Besides  exposing  the  crews  to  advantages  and 
disadvantages  of  other  airfirames,  networked  simulation  will  also  help  reduce  the  language  barrier 
between  the  different  commands  and  squadrons.  Crews  will  learn  specific  dissimilar  formation 
tactics  (e.g.,  rotor  clearance,  power  requirements,  LZ  requirements),  as  well  as  be  exposed  to 
problems  diat  can  arise  when  executing  dissimilar  platform  tactics. 

A  fifth  area  cited  by  11  participants  concerns  planning  and  replanning.  Among  the 
benefits  cited  for  planning  includes  the  opportunity  to  do  what-iffmg,  validate  route  timing,  cross 
check  waypoint  selection,  observe  threat  indications,  prepare  threat  avoidance  tactics,  and 
provide  mission  briefbacks  to  squadron  and  wing  commanders. 

A  sixth  area  that  was  cited  involves  coordination  of  higher  level  tactics  and  plans  among 
crewmembers,  crews,  and  commands.  Of  the  13  responses  in  this  category,  the  major  virtues  of 
networked  training  were  seen  in  such  subareas  as  getting  together  after  the  routes  are  completed, 
coordinating  SOF  and  CSAR  forces  (from  ACC),  standardizing  training  across  the  commands, 
providing  more  exposure  to  multiple  players,  promoting  higher  situation  awareness,  fostering 
better  CRM  and  crew  interactions  in  general,  improving  multiservice  interactions  (e.g.,  Army/Air 
Force),  and  supporting  additional  coordination  training  to  deal  with  inevitable  problems 
concerning  radios  in  which  “being  able  to  talk  to  someone  (other  than  the  instructor  inputs) 
really  helps  coordination.” 

Finally,  the  remainder  of  the  positive  responses  (11)  fall  under  the  category  of 
miscellaneous  positive  benefits.  These  run  the  gamut  fi-om  such  gains  as  incorporating  aspects  of 
real-world  missions  by  hearing  and  seeing  others  to  task  saturating  the  crews,  learning  to  work  in 
a  high-stress  environment,  “seeing  how  one’s  decision  affects  others,”  promoting  improved 
meAods  of  task  prioritization,  improving  the  intensity  and  realism  of  training,  testing  new 
tactics,  giving  new  crewmembers  a  feel  for  how  “missions  should  run,”  helping  inexperienced 
crewmembers  experience  the  high  pressures  of  adapting  to  mission  changes,  capturing  lessons 
learned,  and  allov,ing  “  human  error  to  enter  the  model.” 

Additional  Comments 

Participant  responses  to  the  Additional  Comments  segment  of  the  survey  were  mixed.  Of 
48  responses  to  this  question,  21  could  be  classified  as  “positive,”  19  as  “basically  negative,” 
and  8  as  “constructively  negative.”  Considering  first  the  positive  responses,  participants  cited 
the  following  specific  features  of  networked  training  most  often:  role  playing  by  dynamic 
aggressor,  integration  of  threats  into  training,  opportunities  for  ARs  with  other  simulators,  and 
coordination  with  other  aircraft.  The  remainder  of  the  positive  comments  tended  to  be 
nonspecific,  as  typified  by  comments  such  as  “very  good  simulation,”  “thanks  for  helping  me 
improve,”  and  “overall  not  bad.”  Perhaps  the  most  typical  reaction  of  this  segment  of  the 
survey  participants  are  such  statements  as  “Good  but  still  has  some  technical  glitches”  and: 
“  Good  training.  It  needs  to  be  refined  somewhat.  But  it  is  an  excellent  start.  And  someone  has  to 
lead  the  way.” 
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Comments  were  classified  as  “constructively  negative”  if  the  participant  failed  to 
identify  anything  positive  about  the  networked  training  but  at  least  pointed  out  areas  where 
improvements  might  be  made.  The  most  likely  areas  for  improvement  included  the  navigation 
logs,  flight  charts  and  other  planning  materials;  upgrading  the  cockpit  and  engine  of  the  MH-60G 
WST  to  line  unit  standards;  and  changing  the  location  of  the  infil. 

Finally,  negative  comments  encompassed  a  wide  range  of  topics.  In  some  c^es,  the 
comments  were  fairly  general,  such  as  “the  mission  did  not  challenge  my  duty  position”  or  the 
“  A/R  is  unrealistic  and  worthless.”  For  the  most  part,  though,  negative  comments  were  aimed  at 
specific  aspects  of  the  networked  simulation.  Among  SOFNET’s  most  critiqued  features,  some 
participants  wanted:  more  challenging  missions  (e.g.,  dual  drop  or  static  line  drop  to  infil  a 
team),  more  extensive  training  on  SOFPARS,  more  EP  training  and  “fewer  MOST  missions,” 
more  integration  of  the  MH-60G  FE  into  the  SOFNET  team,  better  maps,  more  time  for  mission 
planning,  more  involvement  of  the  MC-130P  CS  in  the  scenario,”  equal  radio  volumes  across 
WSTs,  and  to  have  onboard  AGSs  to  help  the  task-saturated  helo  pilots. 


CONCLUSIONS  AND  RECOMMENDATIONS 

Discussion 

Despite  the  high  ratings  we  reported,  our  observations  of  the  SOFNET  training  sessions 
highlighted  a  number  of  problems.  Presently,  SOFNET  mission  training  practice  is  not  focused 
on  any  set  of  tangible  training  objectives,  nor  is  it  geared  to  take  full  advantage  of  the  strengths 
of  the  training  methodology.  SOFNET  training  also  requires  a  great  amount  of  time  to  develop 
and  conduct  (the  training  ^y  is  often  greater  than  10  hours).  This  time  might  be  better  used 
elsewhere  in  either  the  ART  or  mission  qualification  (MQ)  curriculum.  Along  this  line,  the  full- 
day  experience  of  SOFNET  training  precludes  an  opportunity  to  provide  further  focused  training 
on,  for  example,  aircraft  systems  and  emergency  procedures. 

Next,  the  SOFNET  scenario  is  cmrently  scripted  in  an  imclassified  database  using  a 
fictitious  country  setting  with  made-up  names.  Little  perceived  value  exists  for  ART  purposes  to 
promote  simulated  mission  operations  in  an  artificid  manner.  Using  fictional  names  simply 
makes  the  scenario  more  difficult  to  remember,  or  relate  to  any  personally  held  “mental  model” 
of  the  world.  Conversely,  crewmembers  report  a  preference  for  conducting  complex  mission 
operations  in  real-world,  “hot-spot”  locations  in  which  they  are  familiar.  A  simulated  mission 
scenario  requiring  such  manner  of  operations  would  promote  an  enhanced  credibility  that  adds  to 
the  fidelity  of  the  networked  training.  Moreover,  such  a  strategy  could  encourage  training 
participants  to  accept  their  mission  tasking  with  appropriate  seriousness  and  involved  thought. 

Additionally,  the  ability  to  encounter  threats  and  apply  tactics  in  a  real-time,  networked 
environment  is  a  simulation  training  advantage  that  cannot  be  replicated  in  the  aircraft.  It  has, 
however,  been  reported  that  the  mission  script  should  include  a  greater  threat-saturation  level  for 
all  network  players.  The  threat-modeling  capabilities  of  the  network  simulation  are  a  significant 
advantage  over  standalone  training  because  live  threat  encounters  require  crewmembers  to  think 
and  act  in  real  time  to  the  unknown  attributes  of  combat  adversaries—a  characteristic  that  can 
only  be  partially  replicated  by  the  use  of  a  moving  model  system. 

Finally,  certain  SOFNET  system  characteristics  also  exist  (e.g.,  threat  p^ameter 
manipulation  while  in  networked  mode)  that  make  it  difficult  for  simulator  instructors  to  instruct. 
We  would  provide  information  to  help  ascertain  where  the  training  system  “roadblocks”  are,  and 
how  these  might  be  effectively  dealt  with  to  improve  overall  training.  Finally,  it  was  reported 
that  the  present  SOFNET  mission  scenario  is  “fun,”  but  is  only  challenging  for  pilot 
crewmembers.  Non-pilot  crewmembers  are  not  receiving  effective  training,  and  are  often  only 
“  along  for  the  ride.” 
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Implications  of  the  SOFNET  Training  Method 

We  have  established  that  the  SOFNET  training  method  is  an  effective  means  for  mission 
crews  to  train  for  joint  operations  coordination  and  procedures.  Certain  changes  are  necessary, 
however,  before  die  full  benefit  can  begin  to  be  realized.  For  example,  the  mission  training 
scenario  should  be  restructured  to  include  a  greater  amount  of  systems  and  emergency 
procedures  training.  To  that  end,  we  propose  that  a  greater  emphasis  on  the  development  of 
training  objectives  and  focused  strategies  be  provided. 

Additionally,  crewmember  participation  roles  should  also  be  equalized  across  WSTs, 
such  that  all  participants  are  involved  and  tasked  to  perform  at  similar  training  levels.  The  actual 
time  spent  m  the  simulators  performing  the  mission  scenario  should  be  shortened.  It  is  counter¬ 
productive  to  prepare  crewmembers  to  perform,  for  example,  in  the  threat  environment,  and  then 
task  them  to  fly  for  two  hours  in  the  simulator  before  anj^ng  interesting  happens.  Tied  to  this 
point  is  a  great  need  for  more  face-to-face  time  between  mission  crews  as  they  plan  and  prepare 
for  their  joint  mission  operation.  It  is  proposed  that  the  actual  time  cut  out  from  the  simulator 
penod  would  be  better  utilized  by  providing  a  longer  and  more  focused  (team)  mission 
preparation  session. 


u  CO  benefit  to  continuing  sponsorship  of  the  SOFNET  training  method  is  to  put 

the  58  SOW  out  in  firont  with  regard  to  the  implementation  of  advanced  networked  training 
protocols.  The  58th  owns  a  one-of-a-kind  training  capability,  that  with  relatively  minor 
Mjustment,  can  become  the  model  for  the  establishment  of  advanced  Distributed  Mission 
Trai^g  (pUT)  foundations  and  principles.  This  training  has  the  potential  to  not  only 
sigmficantly  improve  the  combat  mission  readiness  of  the  warfighter,  but  to  also  increase  the 
effectiveness  of  joint  combat  mission  operations. 

Implications  for  Further  Research 


We  propose  a  continuation  and  expansion  of  the  present  lines  of  our  SOFNET  evaluation 
using  our  questionnaire,  and  session  observations.  Data  collected  from  such  further  research 
would  provide  prescnptive  guidelines  and  recommendations  which  could  enable  a  greater 
understandmg  of  effective  team  coordmation  and  mission  performance.  The  results  of  such  an 
mvestigation  would  dso  produce  data  for  CMT  instmctors  and  training  developers  to  identify 
what  constitutes  slall  m  aircrew  team  performance  protocols  and  procedures,  thereby  supporting 
feedback  pd  remforcement  procedures.  Training  interyentions  could  then  be  developed  to 
improve  aircrew  coordmation  m  task-specific  situations  where  a  high  level  of  interdependency  is 
reqmred  between  members  due  to  unpredictable  or  highly  complex  missions  ^ 
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APPENDIX  A 


SOFNET  SURVEY 

The  Armstrong  Laboratory  Aircrew  Training  Research  Division  (now  known  as  the  Air  Force  Research  Laboratory, 
Warfighter  Training  Research  Division)  has  been  sponsored  by  the  58th  TRSS  to  collect  certain  information  on 
research  issues  in  network  simulation.  Your  participation  is  greatly  appreciated,  and  responses  will  be  treated  with 
full  confidentiality. 

PART  I.  Please  complete  the  following  crewmember  background  survey. 

Rank/Name  _ _ _  Aircraft  - ^ - 

Crew  Position  _ _ _  Squadron  - 

Flight  experience  (approx,  hours)  _  Simulator  experience  prior  to  this  week? 

YES  /  NO 

PART  II.  Based  on  today’s  experience  with  the  network  mission,  please  answer  the  following  questions. 

1 .  How  clear  was  your  specific  role  as  a  network  player  in  the  mission  script  once  the  in-brief  ended?  What  might 
have  been  done  during  the  in-briefing  to  help  clarify  your  role  or  requirements? 


2.  Were  there  aspects  of  the  mission  script  that  required  you  to  support  the  actions  of  another  crew  that  were 
artificial  or  unrealistic?  Please  explain. 


3.  In  what  ways  did  your  mission  plan  change  as  a  result  of  interaction  with  other  mission  team  players?  What 
team  interactions  were  helpful  or  not  helpful?  What  other  team  interactions  would  have  made  the  training  more 
realistic? 


4.  How  is  training  in  a  joint  networked  simulation  mode  likely  to  affect  your  real-world  chances  for  mission 
success?  Which  areas  of  the  mission  are  most  likely  to  be  affected?  Please  explain. 


5.  Additional  Comments? 
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PART  ill.  Please  rate  the  value  of  networked  simulation  relative  to  standalone  simulation  for  training  the  following 
mission  elements. 


Unacceptable 


Less  value  than 
standalone 


Same  value  as 
standalone 


Better  value  than 
standalone 


Networking  is 
essential  for  this 
element 


NA 

Not  applicable  or  not 
performed 


Mission  Element 


1.  Mission  Planning 


2.  Tactics  Planning 


3.  Mission  Briefing 


4.  Low-Level  Planning 


5.  Night  Operations 


6.  Low-Altitude  Operations 


7.  Radar/FLIR  Interpretation 


8.  Secure  Communications 


9.  Multiship  Tactics 


10.  Threat  ID  &  Response 


11.  CSAR  Operations 


12.  Airdrop  Operations 


13.  Weapons  Employment 


14.  Transload  Operations 


16.  Air  Refueling  Operations 


16.  Terrain  Familiarization 


17.  Formation  Flight 


18.  In-Flight  Problem  Solving 


19.  Threat  Avoidance/Evasion 


20.  Checklist  Procedures 


21.  Systems  Malfunctions 


22.  Crew  Coordination 


23.  Situation  Awareness 


24.  Time  Management 


25.  Command  &  Control 


26.  Minimum  WX  Operations 


27.  Mission  Diverts 


28.  Infil/Exfil  Operations 


29.  Fuel  Management 


30.  Chaff/Flare  Management 


31.  Mission  Debriefing 


32.  Mission  Team 
Coordination 


33.  Overall  Value 


Rating 


1  2  3 


1  2  3 


1 


1  2  3 


Comments 


5 

NA 

6 

NA 

5 

NA 

5 

NA 

5 

NA 

5 

NA 

6 

NA 

5 

NA 

5 

NA 

5 

NA 

5 

NA 

6 

NA 

5 

NA 

5 

NA 

6 

NA 

6 

NA 

5 

NA 

5 

NA 

5 

NA 

6 

NA 

5 

NA 

6 

NA 

5 

NA 

6 

NA 

5 

NA 

5 

NA 

5 

NA 

6 

NA 

5 

NA 

5 

NA 

5 

NA 

APPENDIX  B 


o  proDtems  wiin  one 
exception.  There  was 
not  a  “hit”  time  givea 
which  was  needed  to 
figure  the  flight  plan 
and  determine  T/0 
time. 


0  problem  witn  wnat 
we  were  going  to  do 


uestion  3:  In  what  ways 
did  your  mission  plan 
change  as  a  result  of 
interaction  with  other 
mission  team  players? 
What  team  interactions 
were  helpful  or  not  helpful? 
What  other  team 
interactions  would  have 
made  the  training  more 
realistic? 


eaiistic  Change  when  neio 
went  single  engine.  Perhaps 
more  enroute  threats  would 
enhance  scenario. 


uestion  4: 
training  in  a  joint 
networked 
simulation  mode 
likely  to  affect  your 
real-world  chances 
for  mission  success? 
Which  areas  of  the 
mission  are  most 
likely  to  be  affected? 
Please  explain. 


oordination  require 
is  excellent,  but  I  am 
not  sure  we  need 
networking  to 
accomplish  that. 


_ itional 

Comments 


At  this  point  in  time 
and  training,  the 
experience  level  of  the 
crew  force  I  think  that 
a  MOST  and 
networked  mission 
may  be  less 
productive  than  3 
system  refreshers  and 
a  MOST/  networked 


ot  at  all;  air  refueling 
coordination 


es,  affected  areas 
would  be  the  “weak” 
links,  such  as 
communication, 
bump  plans,  etc. 


tor  mis 

was  a  standard 
training  mission.  For 
a  simulator  mission, 
we  need  more 
challenges.  Maybe  a 
RAM/personnel 
airdrop,  or  dual  drop, 
or  static  line  drop  to 
infil  a  team.  Also,  at 
least  one  threat 
engagement  is 
recommended 


ifferent  AK  configuration. 
It  was  helpful  to  have  to  deal 
with  the  change. 


we  would  nave  probaoiy 
stayed  near  the  island  and 
had  the  ship  come  to  us  since 
we  were  single  engine.  We 
could  have  established  an 
AR  track  near  the  island. 
Would  have  been  a  good 
idea.  Wish  I  had  thought 
about  it. 


s  realism  m 
more  human 
interaction  is 
involved.  However, 
the  physical  act  of  AR 
in  the  simulator  is 
probably  3  times 
harder  than  it  is  in 
real  life. 


Clear,  out  it  would 
help  if  the  course  were 
long  enough  to  allow 
the  crews  to  do  more 
mission  planning 
before  each  sim. 


Knew  1  was  to  tly  helo 
formation  and  work 
with  a  tanker.  More 
detailed  “  role 
players,”  filling  in 
voids  that  the  sim  has. 
i.e.,  give  us  the  aft 
180°  perspective  in 
words. 


oooa  oner,  impression 
was  this  is  a  standard 
SOF  mission.  Just  like 
I’ve  been  flying  for 
years. 


u  was  not  as  clear  as 
normal  missions  due  to 
lack  of  time  to 
examine  and  question 
the  plan. 


me  roie  was  specitic. 
However,  1  am  a 
rescue  pilot  and  this  is 
not  one  of  my 
missions.  I  did  enjoy 
the  opportunity  to  do  a 
SOF  mission  but  I 
needed  more  training 
to  effectively  integrate 
(terminology,  tactics, 
etc.). 


we  had  to  learn  to  think 
about  the  different  aircraft 
capabilities  and  adjust  our 
actions  accordingly,  i.e.., 
different  airspeed, 
acceleration/decel  rates  and 
different  defensive  systems 


everyone  jump  thru  their  ass, 
as  it  would  be  in  a  real-world 
scenario.  Team  intercom  was 
audible  on  intercom,  sort  of 
gave  away  what  was  going 


^ere  required  to  adjust  due 
to  MH-60G  dropping  out. 
Even  though  this  was  a 
technical  glitch,  it  was  a 
realistic  scenario. 


nor  time  available  to 
interact  with  the  H-60  crew 
limited  our  ability  to  resolve 
any  terminology  differences. 
The  amount  of  training 
conducted  today  was  good 
overall. 


interaction  was  good.  We 
learned  some  of  the 
limitations  of  the  Pave  Low. 


e  would  not 
have  executed  this 
mission  with  700 
engines.  The 
power  limitations 
were  excessive. 
We  could  not 
even  AR. 


oood,  insertion  and 
the  outbound  leg. 
Things  like  a  spare, 
good  refueling  prior 
to  or  Just  after  inser¬ 
tion.  Better  intell!  It’s 
training,  but  in  the 
real  world,  we  will 
receive  better  intel. 

To  try  this  in  the  real 
world,  it  would  not 
happen.  Sure  it’s  the 
sim  but  you  tell  us  to 
play  it  as  real.  I  would 
expect  it  from  this 
also. 


It  helps  by  simulating 
threat  and  emergency 
problems 

necessitating  bump 
plans  and  flexibility 


ureatly,  anything  that 
forces  decisions  that 
are  unexpected,  helps 
younger/inexperi¬ 
enced  crewmembers 
to  feel  the  high 
pressure  of  real-world 
changes  and  makes 
them  adapt 


It  s  realistic  m  the 
many  different 
situations  that  occur 
due  to  dissimilar 
aircraft  integration. 


It  wm  greatly  reduce 
the  amount  of  re¬ 
planning  done  due  to 
a  lack  of  knowledge 
of  incorrect 
information  about 
other  platform’s 
capabilities  or 
restrictions. 


1  raining  will 
definitively  improve 
success  potential.  I 
focused  myself 
continually  thinking 
in  the  combat  mission 
mode.  Result  would 
be  high  situation 
awareness  and  fewer 
mistakes.  Areas  to  be 
affected  would  be 
objective,  run-in,  and 
the  egress  as  well  as 
comm  issues. 


e  interaction  wi 
was  good.  I  think  there 
would  have  been  more  comm 
with  a  real  ABCCC.  We 
needed  interflight.  P’s/threat 
call  fteq,  and  package  fteq. 


rave  low  rts  need 
extensive  training  on 
SOFPARS.  Currently 
engineers  in  the  field 
have  very  little  experi¬ 
ence  with  SOFPARS. 
This  is  required  due  to 
Pave  FE’s  pivotal  role 
onboard  the  Pave  Low 


etter  mission 
planning  cells. 


Id  not 
include  enough 
supporting  materials 
for  back  end 
crewmembers  (CSO) 
to  plan  EPA. 


o  proDiem  witn  our 
roles. 


Planned  orbits. 

No  supporting 
player  calls  that 
affect  our  (MC- 
130P)  decision 
making  realism. 
Unrealistic 
mission  role-why 
not  useMC-130P 
for  transload? 


Yes!  ij^nadow 
A/C  was  to  depart 
early  and  orbit  on 
the  AR  track  that 
was  covered  by 
enemy  EW  radar 
prior  to  helo/ 
tanker  ingress. 

2) OurDZ 
(Pueblo)  had  an 
enemy  Areat  on 
the  field.  We 
wouldn’t  go  there. 

3)  The  transload/ 
FAARP/DZ  at 
Pueblo  was  un¬ 
realistic  partly  as 
a  result  of  #2. 
Also,  it  seemed 
ridiculous  for  us 
to  insert  a  team  to 
secure  a  field  for 
FAARP/transload. 
The  helos  didn’t 
even  require  the 
first  AR. 


it  1  were  tasKed  as 
printed  in  the  mission 
packet,  would  think 
that  the  planners  had 
no  idea  of  the  capabil¬ 
ities  of  the  H-60.  May¬ 
be  it’s  there  to  make  us 
crewmembers  change 
the  plan,  I  don’t  know. 


enormance 
required  from  60s 
with  700  engines 
was  unrealistic. 
Mission  require¬ 
ments  didn’t 
match  aircraft 
abilities. 


ission  was  anected  by 
early  T/0  of  helos.  Had  to 
compress  flight  plan  and 
checklists  adding  a  realistic 
amount  of  “stress”  not 
normally  encountered  single 
ship. 


elos  departed  early  witnout 
notifying  us.  Our  ARCT  was 
predicated  on  their  take  off 
time.  Hence,  we  were  late  for 
the  CT  before  we  even 
departed. 


Other  team  interactions 
would  have  helped  and  made 
the  mission  more  realistic  by 
using  additional  agencies 
such  as  a  SOCCQ,  AWACS, 
CP,  etc.  Otherwise,  good 
communications. 


w  iin  me  current  plan,  me 
60  could  only  recover  the 
team  it  carried  in  plus  1 
person.  So  the  53  was 
required  to  take  up  this  role. 
I  felt  we  interacted  well  with 
an  overview,  crew  brief, 
return  for  study,  then  get 
together  for  final  questions. 


1  aciics  empioyea  to  evaae 
enemy  aircr^  weapons  was 
more  dynamic  with 
networked  simulation. 
Required  consideration  of 
2nd  aircraft. 


me  planning  and 
interaction  with 
SOF/rescue  forces 
needs  to  happen.  It  is 
probably  not  in  any 
0-plan  but  it  may  just 
happen  in  a  war. 
History  repeats. 


mbaoiy  good  tor  a 
very  young  crew.  This 
scenario  was  too 
much  like  JRTs  to 
change  my 
performance 
significantly. 


is  IS  immensely 
valuable  training  that 
exposes  us  to  the  “  fog 
of  war.”  I  think  it 
would  be  good 
training  to  have  a 
mission  with  no 
programmed 
malfunctions  because 
the  malfunctions 
create  an  air  of 
uncertainty  due  to  the 
role  playing  required. 


1  think  the  team  interactions 
make  the  simulation  realistic. 


100  mucn  empnasis 
on  tactics.  During  sim 
refresher,  2  tactical 
sims  too  much.  Leave 
SOFNET  mission  in, 
change  MOST 
mission  or  at  least 
eliminate  second 
mission  planning 
session. 


aside  from  the  threats 
and  malfunctions,  this 
scenario  is  what  we  do 
at  the  schoolhouse  and 
out  in  the  field  go  on 
for  every  TAG  flight.  I 
would  not  use  the 
SOFNET  to  replace 
normal  annual 
simulator 
requirements.  The 
sortie  today  was 
immensely  valuable, 
but  we  lost  other 
important  trsuning, 
hydraulics  refresher, 
pneumatics  systems, 
TOLD  data,  etc. 
because  of  the 
SOFNET  sortie.  We 
can’t  make  it  up. 


Networked  simulation 
mode  would  make 
your  real-world 
chance  for  mission 
success  an  increased 
possibility.  The  simu¬ 
lation  mode  network 
gives  you  the  ability 
to  operate  anywhere 
on  the  earth. 


Networking 
incorporates  good 
aspects  of  real-world 
missions  by  hearing 
and  seeing  others. 


leei  It  can  enhance 
the  need  to  under¬ 
stand  each  other’s 
limitations/capabil¬ 
ities.  Sometimes  say 
same  things  in  a 
different  language. 
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ear,  mostly. 
However,  without  the 
AGSS,  the  FE  role  was 
significantly  limited. 


cry  Clear, 
materials  to  develop 
mission  concept. 


1)  me  scenario 
needs  work.  The 
conditions  for 
weight,  temp,  DA 
made  it  imposs¬ 
ible  given  aircraft 
performance 
capabilities. 

2)  Without  AGSS 
capabilities,  dog¬ 
fighting  wi^  the 
HIND  was 
unrealistic. 

Cannot  scan  360® 
like  we  would  be 
able  to  in  real  life. 

3)  We  are  a  rescue 
crew.  This  was  a 
SOF  mission.  We 
don’t  normally  fly 
withH53s.  OK 
for  familiariza¬ 
tion,  but  other¬ 
wise  unrealistic. 


1  anKer  luei  onload  was  real 
slow.  Otherwise,  my  comm 
on  left  observer’s  ICS  cord 
carried  only  ICS  trans¬ 
missions.  I  could  not  hear 
any  radio  transmissions, 
significantly  limiting  my 
situation  awareness,  and 
effectiveness  in  crew 
participation/interaction  very 
restricted. 


i  m  not  sure, 
would  not  normally 
fly  with  H-53s. 


Fretty  clear,  but  was 
updating  the  clarity 
throughout  the  day. 


1  nere  were  some 
holes. 

1)  An  IMOM  product 
with  threats  degraded 
like  you  would  see  at  a 
JSOTF. 

2)  If  preplanned,  an  LZ 
with  correct 
coordinates. 

3)  More  terminal  ops 
data  (e.g.,  imagery, 
etc.) 


ore  time  to  review 
package  and  do 
deliberate  planning. 
No  AMC  identified. 


Fretty  clear,  more 
detail  in  the  inbrief 
would  have  been  nice 
(ROE). 


peciiic  tasking  was 
provided. 


Y  es,  mission  pian 
for  60s  seemed  to 
use  new  engine 
data  (701s)  for 
TOLD-even 
though  the  60  sim 
uses  old  700 
engines.  As  a 
result,  we  had  to 
take  more  weight 
which  made  our 
power  margins 
closer. 


Yes; 

rules/procedures 
between  aircraft 
and  commands 
are  needing 
combination  to 
ensure  that  the 
crews  identify 
what’s  different. 


interaction 
between  crews 
improves  the 
whole  sim  profile. 


Yes,  simulators 
(MC-130P,  53, 
60)  did  not  have 
an  airspeed 
comparison  that 
matches  that  of 
the  aircraft.  I  had 
to  fly  too  slow  for 
the  helo  during 
AR. 


look  on  weight  (see  i 
More  time  between  crew 
prior  to  flight.  Watch  mixing 
and  matching  Special  Ops 
and  rescue  crews  with  as 
little  prep  time.  Our 
paradigms  are  different 
(SOPs,  etc.).  Interoperability 
is  hampered  with  such  little 
time. 


ore  01  a  ground  team  sheet 
for  scripting,  i.e.,  ROE,  team 
brief,  and  assault  plan. 


1  he  joint  network  is 
very  much  needed. 
We  don’t  train  the 
same— this  will  bring 
us  closer. 


uooG  overall  mission 
-  not  too  tasking,  but 
keeps  you  constantly 
busy!  Work  out  the 
bugs  and  this  scenario 
will  be  great. 


reats  an 
data  (target)  bases 
loaded,  it  is  a  great 
mission  rehearsal 
tool. 


ittle  change  in  the  mission 
but  all  the  interaction 
depends  on  the  other  crews. 
AFSOC  has  different  training 
and  tactics  than  rescue  crews. 


ad  to  adjust  l  u  i  s  based  on 
completing  AR  late.  ABCCC 
interaction  was  helpful. 


orm  4  m  detail 
for  each  airplane 
would  be  great. 


mis  is  exacuy  me 
type  of  mission  we 
would  expect  to 
encounter  and  these 
were  the  types  of 
problems  I  would 
expect. 
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av  Uur  roie  was  very 
specific 


oie  was  Clear. 


Mission  scenarios/ 
planning  can  be 
improved  with  a 
FRAG  sheet  that  puts 
all  the  appropriate  data 
on  the  kneeboard. 


ine  airarop  ana 
transload  may  not 
have  been  needed. 
Possibly  you 
could  compromise 
the  DZ  witii  the 
barlock  forcing 
another  AR  and 
no  transload. 


urigmai 
temperature  and 
weight  was 
unrealistic. 
Normally  would 
have  more  than 
one  PAVE  LOW 
to  do  the  mission. 
The  60G  was 
unable  to  cany 
any  of  the  PCs 
out. 


or  more  realistic  training, 
have  SAM  threats  closer  to 
flight  routes.  Be  able  to 
determine  if  crew  survives  or 
not  based  on  tactics  and 
countermeasures.  Inability  to 
offload  fuel  to  helos  caused 
delay  in  H-hour.  Late  T/0 
by  Shadow  A/C  caused  delay 
to  contact  time.  Shadow 
stayed  with  helos  as  long  as 
possible  to  provide  fuel. 
Future  possibility-challenge 
teams  to  refuel  in  nonper- 
missive  environment. 

Engage  with  threats  to  see 
how  crews  would  react  to 
survive!  together  (real-world 
tactic  question). 


Mission  plan  was 
straightforward  with  a 
defined  task.  Changes  were 
minimal.  It  was  nice  having 
the  interaction  because  of  the 
real-time  emphasis  placed  on 
planning.  Formation  brief 
should  have  involved  all 
assets  to  include  role  call. 


1  was  nappy  wi 
interactions. 


ommunication  is 
key.  Joint  networking 
just  reaffirms  already 
mandatory  comm 
channels  that  must  be 
used  in  real-world 
channels. 


1  ne  way  tne  plan 
was,  the  53  could 
not  have  done  the 
mission,  i.e.,  fast 
rope  at  4300  lbs  at 
29°C  and  720’.  If 
you  want  us  to 
think,  try  to  be  a 
little  closer  to  a 
way  to  do  it  (like 
dropping  the  temp 
from  29°C  to  3°C 
and  so  on. 


aaow  A/c  was 
given  one  crucial  task 
ftime  critical)  to  refuel 
the  helos.  The  second 
task,  airdropping 
team,  was  not  as  time 
critical.  Adjusting 
plan  because  of  helo 
refiiel  delay  seemed 
easy— just  call  up  and 
change  H-hour.  That 
might  not  be  possible 
in  a  real  scenario. 


ihe  what-ining 
provides  a  sense  of 
realism.  Again,  the 
formation  pre-brief  is 
a  must  for  all  players. 
This  experience  as 
well  as  that  of  real¬ 
time  communications 
provides  sound 
experience  for 
crewmembers. 


The  comm  glitch  was 
realistic.  I’ve  never 
seen  comm  go  well 
and  relaying  through 
ABCCC  and  not 
being  able  to  talk  to 
the  helos  was  true  to 
form. 


ncreasea  mission 
success  through 
practice  interaction. 
We  never  get  that 
unless  at  a  JCET/JRX. 
It  is  absolutely  key  to 
our  success.  The 
mission  area  most 
likely  to  be  affected  is 
C3. 


owsyou  now  muc 
your  decisions  affect 
other  people. 


,  not  ba 
Great  job. 
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.  little  better 
discussion  on  LZ 
intentions.  We  had  to 
create  some  of  our 
own  assumptions  after 
the  briefing. 


ery  Clear,  i 
scenario  was  very 
realistic  and 
comprehensive. 


My  specincjob  was 
clear  but  extremely 
limited  compared  to 
actual  aircrzrfl.  With 
the  gunner  simulator, 
this  would  be  greatly 
improved.  That  said,  I 
think  there  is  a  need 
for  a  60-specific 
gunnery  simulator.  By 
Siat,  I  mean  one  in  the 
53  bay  and  one  in  the 
60  bay. 


fainy  clear,  as  wiin 
any  preplanning,  more 
time  and  detail  can  be 
done.  But  we’re 
limited  for  sim 
refresher. 


oie  was  Clear  an 
well  understood. 
No  suggestions. 


Directing  the 
HIND 

engagement  when 
the  scanner  on 
both  aircraft 
would  have 
picked  it  up  early 
on. 


inai  LZ  anticipations, 
little  more  mission  planning 
time  would  have  been 
helpful. 


Not  usea  to  tlymg  with  an  H- 
S3  (sight  picture  is  a  lot 
different).  I  feel  that  not 
having  a  viable  left  and  right 
scanner  puts  a  lot  of 
emphasis  on  the  scanning  of 
the  pilot  and  CP  (increases 
workload  when  they  are 
already  extremely  busy). 


ihe  networking  with 
helos  provided  us  with  the 
chance  to  perform  an 
unplanned  AR.  This  was 
great  training  and  could  not 
have  been  done  without 
networking. 


ery  clear- 
acceptable. 


0  -  acceptable 
to  very  good. 
Better  than  some 
real  world,  worse 
than  others. 


Always  Changes  (real  or  not 
Not  a  valid  question  for  me. 


ne  more  tace  to  race 
with  other  players  or 
liaisons  for  the 
appropriate  players. 


Unrealistic.  Our 
unit  will  not  pene¬ 
trate  a  high  threat 
area.  If  we 
practice  for  real 
world,  then  we 
should  execute 
real-world 
scenarios.  I’ve 
been  told  not  to 
train  outside  what 
is  real  for  then  we 
might  in  real 
world  be  tasked 
outside  our 
doctrine 


ihis  IS  great  stun! 

All  missions  involve 
multiple  players.  The 
more  exposure,  the 
better.  Work  out  the 
technical  problems 
and  you’ll  have  a 
great  product. 


software/database 
bugs  worked  out,  this 
would  greatly 
enhance  coordination 
between  crews. 


1  he  maps  need  to 
have  a  different 
format.  The  time  tick 
marks  should  count 
down  to  the  next  LZ 
not  up  from  the 
previous  LZ. 


et  a  way  tor  left  an 
right  scanner  to  be 
part  of  the  crew  more 
on  TAC  missions. 


IS  is  me  premier 
tool  for  mission  pre¬ 
planning. 


uccess  IS  enhance 
by  practicing  all  the 
what-ifs  prior  to 
doing  a  real-world 
mission. 


etworking  is 
definitely  an 
improvement  in 
re^ism  and  intensity 
of  training. 


inis  IS  great  It  all  me 
small  bugs  are 
worked  out.  Very 
realistic,  but  visual 
problems  need  to  be 
adjusted.  HC-130P 
AR  was  unrealistic 
from  tanker  perspect¬ 
ive.  Did  not  appear  or 
“feel”  as  if  helo  was 
taking  fuel  -  had  to 
“simulate”  fuel 
offload. 


ive  you  Ideas  on 
how  it  would  work. 
The  areas  in  which 
you  are  weak  and 
strong  in,  and  through 
lessons  learned,  be 
able  to  correct  so  that 
a  real-world  situation 
can  flow  more 
effective,  and  you 
know  what  you  need 
to  look  for  and  maybe 
do  it  better. 


ery  impressive 
system. 


eat  system  and  lots 
of  fun.  The  only 
problems  were 
software  (aircraft 
disappearing,  etc.). 

I  would  like  to  do  it 
again. 


anks  -  great 
‘MOST’  trsuning. 
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information  we 
needed.  Nothing. 


Yes,  visuals  + 
WST  problems 
caused  us  to  make 
changes.  The  lack 
of  full  visuals 
made  our  left  and 
right  scanners 
useless. 
Unrealistic. 


Increase  it.  Lomm 
planning. 


ole  was  relatively 
clear.  However, 
specific  plans  of  action 
and  mission 
preparation  (i.e.,  map 
study)  could  have  been 
added  to  in-brief  to 
enhance  mission 


ery  clear.  Nothing. 


10  nave  me  mission 
scenario  sooner  so  that 
better  flight  planning 
could  be  done 


ot  that  1  was 
aware  of 


e  mission  plan  was 
essentially  a  special 
operations  profile  which, 
while  a  good  learning 
opportunity  for  all  CSAR 
crews,  required  the  ACC 
crews  to  perform  the  mission 
to  different  standards. 


1  here  were  several  times  that 
we  became  lad  due  to  poor 
map  planning.  Also  there 
were  several  instances  of 
poor  communication  due  to 
diflferent  standard 
terminology. 


we  naa  an  unpiannea  ak. 
The  tanker  was  very  helpful 
with  their  interaction.  By 
providing  us  with  ample 
support  and  interface 
throughout  the  entire 
mission. 


ihe  networked 
simulation  is 
extremely  useful  in 
allowing  crews  of 
various  airframes  to 
train  in  a  realistic 
environment  and 
allow  them  to  test 
tactics  and  procedures 
that  will  ,in  the  long 
run,  enhance  mission 
effectiveness. 


ommumcation 
between  joint 
commands  and 
different  ways  of 
operating. 


inis  was  a  very 
realistic  scenario. 
Being  part  of  several 
JCS  exercises  and 
deployments  myself,  I 
can  say  that  the  more 
often  you  rehearse 
this  scenario  or  others 
that  may  be  planned, 
you  will  probably 
increase  your  mission 
success  rate  about  70- 
75%  (real  world). 
Comms  will  most 
likely  to  be  affected. 


Uiearly  understood  my 
role. 


My  roic  was  clear. 
Better  charts  should 
have  been  made 
available. 


an  Changed  due  to  late 
but  interacting  with  other 
team  helped  recover  from 
potential  problem. 


anges 

were  caused  by  both  internal 
and  external  factors,  but  not 
by  other  teams. 


ery  clear.  Koie  was 
very  realistic.  Reminds 
me  of  a  related 


iNo.  very  goo 
and  well  thought 
out  script.  The 
only  limitation 
may  be  the  num¬ 
ber  of  available 
sims.  This 
mission  would 
probably  use  2 
53s  and  I  60. 


ceded  more  interaction 
between  aircrews  during 
planning.  This  is  a  limitation 
when  “simulating"’  other 
aircraft  instead  of 
networking. 


ositive  enect! 
Realize  the  impact 
and  “  fog  of  war” 
occurs  for  other 


1  think  It  will  impose 
real-world  constraints. 
Working  in 
networked  mode 
helps  expose  other 
player’s  limitations. 


snouid  enhance  our 
real-world 

c^abilities.  The  areas 
most  likely  affected 
will  be 

communication  and 
team  limitations. 


ven  with  occasional 
minor  glitches,  it  is 
still  an  outstanding 
system. 


inis  could  he  the  oest 
training  conducted  all 
week,  but  more 
planning  needs  to  be 
done.  The  mission 
should  be  given  to  the 
crew  at  least  one  day 
prior.  The  crew  needs 
to  study  the  mission 
more.  The  SOFPARS 
charts  are  inadequate. 
The  NAV  logs  are 
inadequate.  Other 
than  some  adjustments 
this  is  great  stuff. 
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Clear  for  the  amount 
of  mission  planning. 
The  info  was  just 
about  right. 


ery  specinc  roies  tor 
53, 60,  and  130. 


n-oriei  was  goo 


ery  clear  except 
would  have  liked  to 
see  an  ATO.  Mission 
needs  more  input  from 
intel,  MC,  and  ATO. 


Some  SA-2 
indications  were 
bogus.  The  HIND 
at  night  (3rd 
world  limited 
night  capability) 
was  somewhat 
unrealistic. 

It  was  good  to  brief  with  the 

60  crew.  However,  different 
procedures,  i.e.,  formation 
lights,  comm-out  procedures, 
etc.,  should  be  standardized 
or  at  least  briefed. 

Yes,  secure  hM 
radio  for  team 
exfil  and  call  for 
fire  support  is  not 
the  standard. 

Should  be  in  plain 
mode  for  quick, 
clear,  concise 
comms 

Didn't  change  much,  53  and 

60  worked  well  supporting 
each  other  as  mission 
progressed.  Didn’t  FAARP 
and  leave  due  to  damage  to 
helo,  planned  to  destroy 
aircraft. 

1  he  team  should 
be  nonsecure 
during  their 
operations  and  to 
use  the  PRC-112 
as  a  backup  or  to 
use  this  radio  to 
call  in  for  helo 
support  and  pick¬ 
up. 

Better  interlace  with  some  ot 
the  other  helo  assets. 

position 
lights  were  on 
during  entire 
mission  even 
though  H-53  crew 
turned  switches 
off.  Use  a  real’ 
world  database. 
Unrealistic 
aircraft 
parameters 
(engines, 
cockpit). 


Use  real  database’s 
terrain.  Could  have 
used  an  overall 
CAP/SEAD  package 
for  certain  parts  of 
mission. 


Need  an 

AFSOC/AETC/ACC 
working  group  to 
work  out  standardized 
procedures  for  these 
types  of  operations. 


rew  coordination, 
trains  the  new 
copilots  in  task 
saturation  and  how  to 
prioritize  their  tasks. 


ission  success 
increases  because 
networic  simulation 
shows  the  differences 
between  how  the 
different  airframes 
operate  and  function 
(comm  procedures, 
emcon,  etc.)  (53  vs 
60). 


upgraded  to  line  unit 
standards  (engines  and 
cockpit).  Get  a  better 
FLIR  screen  which 
responds  correctly  to 
force  controller.  Get  a 
scramble  launch 
rescue  mission  with 
fighter  escort  mission. 
Lots  of  comm  jam  and 
going  into  a  hot  area 
with  a  downed  pilot. 
Get  crews  together 
and  hash  out 
MAJCOM  differences 
before  mission. 


1  ne  maps  were 
pathetic.  Couldn’t  see 
the  Lat/Longs  on  the 
map.  Who  uses  a  map 
in  a  3-ring  binder? 
Route  was  hard  to 
follow  due  to  the 
symbols  or  the  lack 
thereof  Recommend 
the  use  of  real  maps, 
not  computer¬ 
generated.  Also,  the 
crew  should  make 
them,  which  provides 
them  the  opportunity 
for  route/m^  survey 
familiarization. 


iNeeo  real-world 
scenarios,  Intel, 
planning.  Need  better 
realism  (i.c.,  threat 
analysis  was  not  veiy 
realistic).  No  intel 
input,  etc.  Mission 
brief  back  to  CCs,  etc. 
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reatly  enhances. 


very  Clear,  me 
scenario  pretty  much 
outlined  in  detail  our 
objectives. 


No  mission  change.  Uid  not 
notice  any  interaction  that 
was  help&l  or  not  compared 
to  a  standalone  simulation. 


I  he  mission  changed  a  tittle 
due  to  a  hung  hose  after  A/R. 
It  was  helpful  because  it 
made  us  look  at  different 
options  that  affect  the 
follow-on  airdrop. 


B.  None 

C.  The  helo  AR-don’t 
give  up  if  he  can’t 
refuel.  Suffer  the 
consequences. 


Uverall,  nothing  anected  the 
way  that  I  would  operate  in  a 
real  or  simulated  mission. 


it  was  clear  as  to 
intent  of  the  training 
mission.  Go  through  a 
full-mission  brief  and 
have  preplanned 
ARCT  and  other 


me  specinc  roies  were 
explained  very  well. 


simulate  the  calls 
of  our  scanners. 
Once  the  gunner 
sim  is  online,  this 
should  be  fixed. 


It  was  clear  unai  was 
going  on. 


e  mission  didn  t  change 
due  to  team  players. 


0  cnanges. 


very  ncipiui  in 
dealing  with  real-time 
malfunctions  that 
affect  refueling  and 
whatever  follow-on 
missions  (i.e.,  airdrop, 
infil/exfil). 


A.  ^eepossiDie 
problems  here-not 
out  in  the  “desert.” 

B.  Actual  execution 

C.  See  above. 


it  would  be  useiul  to 
first  time  crew¬ 
members,  those  going 
through  initial 
training,  to  give  them 
a  feel  of  how  a 
mission  iriight  run. 
Communications  play 
a  more  important  role 
in  any  mission,  real  or 
simulated,  than  what 
we  receive  here. 


ery  good  simulation. 


more 
involved  in  the 
scenario. 


1  teei  It  will  increase. 
It  certainly  will  not 
hurt. 


1  minx  me  oesi  use  oi 
networked  simulation 
is  in  the  command 
and  control  area. 

Bring  commanders 
who  will  be  AMCs. 
Could  use  the  training 
to  help  in  decision 
making  and  managing 
stress. 


ood  training.  It 
needs  to  be  refined 
somewhat.  But  it  is 
an  excellent  start. 
And  someone  has  to 
lead  the  way. 


ery  clear  an 
specific. 


1  believe  this  type  oi 
scenario  is  very 
helpful  to  prepare  for 
real-world  missions 
and  increase  chances 
for  success. 


n  the  contrary.  1 
think  including 
random  helo  AR 
requests  was  very 
typical  for  our 
missions. 


No,  actually  it 
was  very  realistic 
because  we 
actually  got  to 
add  an  AR  which 
happens  a  lot  in 
exercises. 


ee  above — Kanaom  ak  is  a 
reality  for  us.  Tanker  (KC- 
135  or  KC-10)  support. 


it  didn  t  really  anect 
anything. 


nderstood  my  role 
perfectly. 


op-up  Air  Keiueiing 


e  race  to  race  allowed  lor 
a  clearer  picture  of  the  Mx. 
We  compared  IP,  CP,  Ex 
coordinates  and  MSAs.  All 
interactions  were  helpful. 
No  other  interaction  seemed 
necessary. 


Live  real-time 
changes  to  AR  tracks 
and  offloads  train  for 
real-world  scenarios. 
Bad  Ex  or  marginal 
Wx  on  track  would 
force  tankers  to 
search  for  alt  track  vs 
altitudes. 


1  think  it  will  improve 
real-world  chances. 
Things  aren’t  so 
canned  such  as  an 
opportune  AR.  Helos 
not  exactly  on  track 
or  late  or  coming  in  a 
different  angle,  etc. 


very  realistic  with  the 
pop-up  A/R.  This 
happens  on  almost  all 
exercises.  Very 
valuable  training  for 
realism. 


1  ne  ining  we  were 
looking  most  forward 
to  were  seeing  actual 
threats  and  69 
indications.  They  did 
not  work  on  this 
particular  day.  Butin 
the  future,  the  threat 
portion  of  the  Mx  will 
be  the  most  valuable. 


ommunications  are 
never  this  good  in  real 
world.  Good  training 
as  an  initial  multitask, 
multiforce  exercise. 


When  things  happen 
to  helos  and  they  need 
us  for  last  minute 
A/R-that  is  great  for 
us.  We  need  more 
practice  with  that-I 
think  anyway.  It  only 
makes  us  better. 


Having  just  come 
from  SOF  (55  SOS),  I 
did  nothing  I  haven’t 
been  doing  for  years 
so  I  don’t  feel  I 
gained  anything  from 
it.  For  rescue  crews 
that  don’t  fly  dissimi¬ 
lar  formation  or 
multiship  combined 
SOF-type  missions,  I 
think  tiiey  get  a  lot 
out  of  it. 


Koie-piayed  part  ot 
aggressor.  Myself  and 
another  pilot  just  past 
contact  check  ride  & 
were  placed  in  the 
aggressor  role.  It  was 
of  some  benefit  to  us 
to  think  like  the  “bad 
guy”  and  will  help  us 
prepare  for  the  tactical 
environment.  Further, 
it  was  instructive  to 
see  the  “big  picture” 
and  how  real-world 
missions  will  be 


me  KU  in  my  opinion 
doesn’t  really  feel  a 
part  of  things  being  up 
in  that  room  alone  and 
not  being  able  to  see 
anything  that  goes  on. 


1.  weira  A/K  graphics 
(ofrset  superimposed 
imagery).  2.  Need 
ability  for  FE  and  AG 
to  “see”  to  the  side 
and  aft  to  better  keep 
SA  for  all.  3.  Dissimi¬ 
lar  radio  volume  from 
players  greater  than 
real  world  (need  to 
equalize).  4.  Threats 
don’t  seem  to  come  up 
well  on  RWR. 
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ad  to  PICK  up 
Good  diversion. 


increase.  5uc 
interactions  build  my 
capability  in  comm 
and  being  flexible. 


e  had  to  pick  up  the  Hin 
crew.  They  vectored  us  in. 


an  did  not  change. 


Yes,  using  me 
tracking  screen, 
lead  needed  to 
pass  info  on  bogie 
A/C  to  A-model 
sim  (2),  which  be¬ 
came  redundant. 
The  wraparound 
screen  and  gunner 
stations  should 
correct  this. 


computer  hickups 
caused  us  to  lose  C- 
1 30/FUR  and  no  training  for 
approximately  5  min. 
Helpful-command  and 
control/exccution. 


contingencies 


it  is  good  tor 
coordination  from 
within  the  A/C  and 
with  other  agencies. 
It  also  validates  route 
timing. 


oordmation 
all  A/C  (i.e.,  radios, 
location,  unexpected 
delays/problems). 
A/R,  TOTs,  bump 
plans  (i.e.,  personnel, 
equip,  threats). 


ceded  to  Know 
drcrafl  capabilities— 
scanner,  gunners, 
rockets,  etc. 


will  worK  more 
for  younger  crews  who 
have  no  joint  mission 
experience. 


etworked  scenario  IS  j  1  was  expecting  mis 


network  stuff  to  be  a 
waste  of  time,  but  it 
turned  out  being  one 
of  the  better  parts  of 
die  course. 


great  for  the  comm 
and  big  picture 
orchestration.  Very 
important,  very 
useful. 


xceptlorme  lac 
that  I  have  no 
HIND  experience. 
I  suppose  the 
training  was  good 
for  someone  who 
hasn’t  been 
around  for  very 


,  all  aspects 
were  fairly 
realistic.  The  free 
play  was  good  to 
make  crews  think 
on  their  feet  and 
make  changes  as 
different  things 
occur  during  the 
mission. 


cry  Clear, 
some  MC  (JSOACC) 
directions  (i.e.,  3 
engine  airdrop 
requirements). 


epenas  on  me 
mission.  Could  be 
helpful  in  the  mission 
success  during  real- 
world  contingencies. 


or  new  or 

inexperienced  crews, 
this  is  a  good  way  to 
get  a  taste  of  how 
joint  missions  can  be 
very  task  saturating, 
especially  the  comm 
problems. 


realistic  comm 
and  mission  changes 
(even  if  they  don’t 
directly  affect  your 
mission). 
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Ole  seemed  pretty 
60P  clear. 


idnt  change. 


It  s  always  good  to  plan  wi 
other  crews.  What  would 
have  been  nice  is  more 
planning  time  for  such  a 
threat-intensive  mission. 


Air-to-air 
refueling  very 
tough.  Original 
parameters  for 
P/UatLZ 
required  98% 
power  with  86% 
available. 
Corrected  with 
lower  temp. 


Yes.  tineied 
initial  conditions 
on  takeoff  were 
unrealistic.  Our 
TOLD  required  us 
to  have  better 
engines  (like 
701CsX  less  fuel 
on  takeoff  or  less 
PAX— just  so  we 
could  takeoff. 
Conditions  were 
unknowingly 
corrected  such 
that  we  had  no 
problem  taking 
off  (temp  went 
from  briefed  16®C 
to4®C). 


1  moved  up. 
interfered  with  en  route.  All 
were  good. 


isston  did  not  change. 
Briefing  together  helped 
clear  up  questions/ 
expectations  for  mission. 


od  interaction. 
Need  secure  radios, 
HAVE-QUICK  and 
UHF.  Comm  always 
sucks.  Best  to  make 
it  realistic. 


1  would  think  it  would 
improve  them.  The 
simulator  does  just 
that,  it  simulates — but 
it’s  better  to  practice 
in  the  sim  on  how  to 
evade  threats,  as  well 
as  Join  on  other 
networks  than  to  do  it 
for  real  and  possibly 
have  something  go 
wrong.  Areas  could 
be  affected: 

1)  being  “jumped”  by 
a  HIND/fixed-wing 
(what  will  the 
formation  do). 

2)  someone  in  the 
formation  has  an 
emergency/malfunc¬ 
tion. 

3)  lost  comm— before 
and  after  objective 
(what  will  do). 


ice 

to  see  we’re  able  to 
coordinate  with  other 
aircraft  and  fly 
against/with  each 
other. 


in  a  j-ship  lormation, 
our  plan  was  predicated  on 
load,  and  for  this  reason,  our 
plan  did  not  change. 


Minor  issues  such  as 
comm  changes, 
waypoint  info,  etc. 
that  can  become 
major  problems  if  not 
accomplished 
correctly  arc  easy  to 
identify.  With  this 
information,  we  can 
correct  problems  in 
the  future. 
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